-- Logs begin at Thu 2022-08-04 01:10:24 UTC, end at Thu 2022-08-04 02:37:19 UTC. -- Aug 04 02:08:44.989088 dv-cinder-740146-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 02:08:44.996466 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:08:44 2022] *** Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: nodename: dv-cinder-740146-17-iscsi Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: machine: x86_64 Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: clock source: unix Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: pcre jit disabled Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: detected number of CPU cores: 4 Aug 04 02:08:44.998506 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: current working directory: / Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: your processes number limit is 47680 Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: your memory page size is 4096 bytes Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: detected max file descriptor number: 2048 Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: lock engine: pthread robust mutexes Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: thunder lock: enabled Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 02:08:44.999061 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:08:45.037837 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: Python main interpreter initialized at 0x563d707a49c0 Aug 04 02:08:45.037837 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: python threads support enabled Aug 04 02:08:45.037837 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: your server socket listen backlog is limited to 100 connections Aug 04 02:08:45.037837 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:08:45.038199 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:08:45.038285 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: *** Operational MODE: preforking *** Aug 04 02:08:45.038532 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:08:45.038532 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: spawned uWSGI master process (pid: 103663) Aug 04 02:08:45.038720 dv-cinder-740146-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 02:08:45.039875 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: spawned uWSGI worker 1 (pid: 103664, cores: 1) Aug 04 02:08:45.039875 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: spawned uWSGI worker 2 (pid: 103665, cores: 1) Aug 04 02:08:45.039875 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:08:45.696474 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:08:45.698552 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:08:46.775487 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:08:46.775487 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Aug 04 02:08:46.776073 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:08:46.776073 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Aug 04 02:08:46.777683 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:08:46.777683 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: from cryptography.utils import int_from_bytes Aug 04 02:08:46.778141 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:08:46.778141 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: from cryptography.utils import int_from_bytes Aug 04 02:08:49.241495 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:08:49.242198 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:08:49.242291 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:08:49.242636 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:08:49.242719 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:08:49.242810 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:08:49.242810 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:08:49.242969 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:08:49.243201 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.243340 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:08:49.243518 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.243613 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:08:49.243833 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.243921 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244149 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244254 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244474 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244569 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244808 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.244908 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245128 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245232 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245429 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245517 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245752 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245838 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.245995 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246080 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246303 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246397 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246620 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-iscsi {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246707 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.246934 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247022 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247236 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247336 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247536 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247624 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247848 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.247936 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248148 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248234 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248464 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248559 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248787 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.248877 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.249106 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.249278 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.249414 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.249712 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.249930 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250242 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250337 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250548 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250641 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250856 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.250947 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251188 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251275 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251501 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251588 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251826 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.251910 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252143 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252224 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252445 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252531 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252787 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.252892 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-iscsi {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253094 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253190 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253466 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253568 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253772 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.253860 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254081 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254220 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254385 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254489 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254764 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.254857 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255075 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255170 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255382 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255529 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255698 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255796 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.255999 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256096 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256303 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256401 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256633 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256723 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.256961 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257061 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257286 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257423 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257557 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257645 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257863 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.257951 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258168 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258260 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258465 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258557 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258767 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.258862 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259015 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259102 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259318 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259404 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259592 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259686 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259895 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.259981 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260214 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260302 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260474 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260561 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260744 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.260865 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261062 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261159 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261350 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261445 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261668 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261766 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.261969 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262063 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262269 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262357 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262570 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262657 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262872 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.262958 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263172 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263258 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263473 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263560 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263774 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.263861 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264080 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264181 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264383 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264489 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264723 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.264837 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265037 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265132 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265354 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265465 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265660 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265821 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.265975 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266061 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266359 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266458 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266607 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266692 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.266917 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267009 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267251 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267356 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267595 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267691 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267900 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.267987 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268200 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268294 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268501 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268588 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268834 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.268941 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269132 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269221 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269435 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269523 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269745 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269837 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.269995 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270083 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270293 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270379 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270594 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270687 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270889 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.270982 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271191 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271290 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271489 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271655 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271790 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.271876 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272084 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272171 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272384 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272477 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272702 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.272793 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273003 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273090 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273302 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273398 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273602 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273695 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273901 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.273992 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274205 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274302 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274503 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274593 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274799 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.274891 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275097 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275194 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275401 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275497 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275704 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.275869 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276025 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276164 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276302 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276449 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276593 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276744 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.276908 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277009 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277228 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277420 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277552 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277697 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277832 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.277977 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278116 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278252 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278395 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278533 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278682 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278826 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.278961 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279096 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279238 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279383 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279549 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279688 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279835 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.279978 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280113 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280248 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280409 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280545 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280721 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.280854 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281023 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281161 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281305 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281441 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281605 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281743 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.281901 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282039 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282325 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282469 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282605 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282766 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.282910 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.283580 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.283671 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.283881 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284045 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284175 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284321 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284464 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284601 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284802 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.284889 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285104 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285212 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285405 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285545 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285709 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.285810 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286027 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:08:49.286146 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286360 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286454 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286666 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286758 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.286993 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287084 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287319 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287406 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287632 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287765 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.287942 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288042 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288249 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288337 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288568 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288676 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.288906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289003 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289206 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289293 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289512 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289607 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289819 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.289913 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290129 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290216 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290444 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290553 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290754 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.290841 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291069 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291166 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291369 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291459 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291673 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291771 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.291983 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292071 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292351 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292528 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292648 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292734 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.292924 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293011 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293248 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293350 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293559 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293646 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293877 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.293963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294197 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294298 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294513 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294600 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294824 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.294911 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295129 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295219 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295435 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295520 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295744 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.295835 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296057 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296362 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296459 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296698 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.296791 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297007 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297097 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297316 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297403 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297623 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297727 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.297932 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.298031 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.298235 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.298321 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.298544 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.298631 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.299418 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.299529 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.299742 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.299836 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300050 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300147 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300362 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300455 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300692 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.300782 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301002 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301107 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301311 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301400 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301612 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301699 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.301912 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302009 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302212 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302299 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302514 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302599 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302812 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.302911 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303118 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303204 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303420 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303515 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303726 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.303826 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304053 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304142 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304356 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304441 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304687 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304788 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.304992 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305092 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305298 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305384 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305599 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305762 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.305906 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306043 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306206 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306340 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306490 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306626 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306782 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.306928 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307074 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307217 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307353 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307490 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307672 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.307810 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308004 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308145 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308285 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308429 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308566 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308715 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.308872 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309018 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309154 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309290 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309456 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309595 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309764 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.309911 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310069 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310206 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310374 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310511 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310680 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310830 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.310989 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311127 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311298 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311443 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311608 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311745 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.311927 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312066 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312231 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312367 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312542 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312699 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.312876 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313017 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313184 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313330 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313475 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313617 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313758 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.313894 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314057 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314204 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314394 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314559 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314704 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.314837 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315011 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315165 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315449 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315606 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315694 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315907 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.315993 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.316208 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.316446 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.316546 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.316847 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.316955 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317160 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317257 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317473 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317609 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317828 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.317940 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.318189 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.318313 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.318788 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.318969 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.319097 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.319318 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.319442 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.319674 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.319841 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320055 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320154 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320391 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320546 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320726 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.320902 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321043 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321358 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321471 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321674 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321807 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.321982 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.322125 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.322365 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.322457 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.322850 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.322943 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323166 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323265 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323488 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323577 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323801 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.323892 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324130 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324221 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324443 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324533 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324782 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.324909 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325109 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325206 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325393 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325483 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325710 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.325803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326049 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326140 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326460 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326570 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326684 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326771 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.326993 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327095 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327306 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327391 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327617 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327705 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.327924 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328022 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328232 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328362 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328536 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328649 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328879 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.328983 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.329189 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.329284 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.329492 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.329579 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.329801 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.330384 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.330624 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.330711 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.330948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331062 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331266 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331365 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331570 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331680 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331883 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.331971 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.332212 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.332303 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.332544 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.332806 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.332898 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333138 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333248 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333445 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333532 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333753 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.333841 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334071 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334168 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334378 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334688 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334791 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.334993 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.335247 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.335338 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.335589 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.335793 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.335888 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.336194 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.336360 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.336511 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.336830 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.336975 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.337133 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.337443 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.337538 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.337778 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338043 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338131 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338344 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338646 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338750 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.338963 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.339243 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.339410 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.339569 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.339826 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.339999 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.340149 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.340315 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.340477 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.340730 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.340906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341053 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341203 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341347 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341493 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341616 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341714 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.341796 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342044 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342131 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342355 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342466 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342666 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342776 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.342994 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343156 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343307 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343395 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343614 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343712 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.343921 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344008 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344233 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344370 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344642 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344782 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.344966 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.345128 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.345288 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.345454 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346261 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346418 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346549 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346671 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346798 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.346940 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347163 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347319 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347470 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347619 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347771 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.347931 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348074 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348213 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348363 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348570 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348798 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.348892 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349007 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349129 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349294 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349411 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349653 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349789 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.349969 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.350091 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.350346 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.350550 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.350707 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.350886 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.351040 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.351392 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.351605 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.351741 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352010 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352145 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352325 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352459 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352665 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352836 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.352979 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.353325 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.353496 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.353650 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.353794 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.353952 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354109 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354252 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354385 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354691 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354832 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.354986 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355121 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355281 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355434 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355583 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355740 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.355882 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.356087 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.356188 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.356398 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.356487 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.356733 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357001 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357142 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357303 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357402 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357603 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357692 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.357915 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358002 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358217 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358307 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358525 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358691 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358829 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.358963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.359110 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.359253 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.359418 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.359513 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.366466 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.366662 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.366782 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.366908 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367000 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367226 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367226 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367393 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367476 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367554 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367632 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367710 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367798 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367891 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367978 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.367978 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368138 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368220 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368305 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368305 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368458 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368543 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368775 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.368871 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369013 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369103 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369191 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369271 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369349 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369427 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369588 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369673 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369759 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369840 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.369925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370005 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370096 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370177 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370243 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370320 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370396 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370473 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370558 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370637 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370714 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370792 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370869 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.370954 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371041 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371120 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371198 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371275 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371360 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371447 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371528 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371613 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371700 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371779 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371857 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.371943 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372023 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372108 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372195 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372274 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372351 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372437 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372518 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372602 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372715 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372797 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372884 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.372965 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373044 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373122 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373206 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373293 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373386 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373467 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373553 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373633 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373710 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373794 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373885 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.373967 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374052 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374132 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374216 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374295 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374390 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374471 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374549 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374626 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374704 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374789 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374870 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.374948 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375025 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375109 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375196 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375282 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375363 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375441 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375507 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375638 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375722 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375810 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375897 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.375983 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376070 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376150 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376235 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376322 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376403 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376481 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376668 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376754 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.376989 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377079 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377323 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377446 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377613 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377714 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.377925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378029 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378229 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378323 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378530 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378623 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378831 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.378921 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379130 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379226 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379430 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379518 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379735 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.379831 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380039 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380127 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380362 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380458 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380691 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380795 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.380997 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381092 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381304 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381399 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381603 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381692 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381909 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.381996 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382207 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382304 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382517 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382605 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382819 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.382907 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383125 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383220 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383425 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383513 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383723 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.383810 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384128 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384344 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384431 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384667 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384759 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.384984 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385079 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385293 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385382 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385604 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385699 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385899 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.385988 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386198 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386284 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386500 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386593 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386803 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.386892 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387107 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387192 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387410 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387532 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387716 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.387816 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388020 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388119 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388323 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388431 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388651 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388751 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.388949 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389047 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389251 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389361 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389553 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389661 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389856 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.389953 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390155 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390263 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390461 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390564 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390762 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.390859 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391061 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391167 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391365 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391460 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391660 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391756 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.391963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.392059 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.392259 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.392356 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393122 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393241 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393446 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393535 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393756 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.393843 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394060 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394148 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394366 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394455 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394668 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394755 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.394976 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395072 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395278 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395366 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395576 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395715 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.395986 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396136 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396277 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396416 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396572 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396728 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.396901 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397004 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397199 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397292 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397507 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397615 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397812 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.397921 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398111 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398208 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398416 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398511 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398716 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.398824 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399016 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399114 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399332 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399436 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399632 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399738 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.399946 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400050 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400275 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400371 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400597 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400715 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.400920 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401017 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401222 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401343 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401526 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401647 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401845 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.401942 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402147 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402244 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402529 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402631 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402855 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.402950 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403154 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403251 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403459 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403547 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403757 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.403870 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404073 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404174 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404388 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404497 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404713 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.404807 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405022 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405115 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405321 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405436 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405639 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405742 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.405957 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406059 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406262 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406359 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406579 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406675 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406900 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.406986 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407207 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407322 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407519 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407608 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407822 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.407916 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.408705 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.408822 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409032 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409165 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409342 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409474 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409648 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409738 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.409949 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410047 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410247 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410364 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410562 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410660 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410860 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.410978 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411165 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411302 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411468 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411605 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411770 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.411906 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412072 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412202 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412369 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412642 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412749 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412832 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.412996 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413133 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413312 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413426 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413617 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413732 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.413914 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414038 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414229 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414344 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414528 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414646 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414843 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.414933 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415146 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415240 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415444 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415532 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415742 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.415832 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416127 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416373 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416461 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416696 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.416791 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417013 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417127 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417345 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417650 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417806 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.417955 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418071 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418257 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418362 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418561 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418658 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418883 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.418983 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419194 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419362 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419503 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419638 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419800 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.419933 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420096 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420251 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420391 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420530 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420704 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.420859 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421007 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421156 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421296 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421434 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421569 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421724 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.421884 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422020 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422159 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422298 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422435 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422580 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422735 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.422873 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423016 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423153 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423293 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423431 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423576 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423748 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.423883 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.424017 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.424585 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.424999 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425233 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425387 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425387 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425656 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425792 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.425937 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426097 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426236 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426330 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426411 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426490 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426577 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426666 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426747 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426825 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426903 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.426981 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427148 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427282 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427466 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427609 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427777 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.427917 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428085 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428176 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428394 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428482 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428725 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.428836 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429128 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429351 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429456 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429665 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.429761 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430013 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430225 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430314 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430548 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430653 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430857 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.430956 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431166 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431254 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431474 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431570 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431781 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.431872 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.432205 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.432362 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.432517 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.432711 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.432850 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433028 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433155 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433341 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433461 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433652 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433784 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.433963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434101 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434274 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434418 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434585 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434747 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.434894 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435060 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435203 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435371 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435511 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435680 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435838 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.435990 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436157 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436343 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436669 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436837 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.436975 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437153 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437290 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437467 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437598 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437780 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.437896 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438093 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438191 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438450 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438540 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438768 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.438855 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439073 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439225 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439412 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439560 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439724 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.439868 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440038 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440175 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440347 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440484 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440673 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.440829 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441003 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441142 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441300 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441461 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441606 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441769 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.441914 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442078 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442225 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442389 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442564 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442845 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.442940 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.443178 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.443268 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.443748 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.443852 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444061 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444197 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444374 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444466 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444706 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.444815 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445021 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445224 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445344 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445568 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445670 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445901 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.445989 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446219 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446524 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446623 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446821 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.446909 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447136 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447224 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447446 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447546 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447745 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.447833 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448045 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448131 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448348 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448443 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448677 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448907 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.448994 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449257 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449357 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449573 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449669 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449875 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.449962 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.450192 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.450294 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.450502 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.450590 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.450802 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451036 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451124 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451389 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451478 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451706 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.451792 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452018 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452106 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452326 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452426 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452635 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452727 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.452949 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453047 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453259 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453357 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453565 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453654 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453867 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.453963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454172 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454260 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454472 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454559 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454773 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.454872 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.455590 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.455686 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.455892 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.455985 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456192 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456293 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456495 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456581 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456815 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.456904 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457115 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457205 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457415 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457514 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457749 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.457879 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458025 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458118 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458322 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458409 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458626 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458713 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.458926 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459022 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459228 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459315 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459527 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459631 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459829 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.459937 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460124 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460219 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460427 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460522 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460748 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.460840 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461052 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461139 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461359 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461526 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461663 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461751 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.461969 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462058 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462275 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462438 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462587 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462726 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.462871 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463006 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463209 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463361 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463505 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463737 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.463876 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464064 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464207 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464379 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464518 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464725 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.464815 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465056 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465162 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465360 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465448 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465661 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465885 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.465973 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466219 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466308 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466537 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466672 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466851 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.466937 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467155 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467245 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467460 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467548 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467768 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.467869 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468071 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468165 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468373 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468460 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468700 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.468807 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469005 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469100 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469307 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469397 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469611 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469727 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.469916 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.470031 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.470217 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.470325 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.470536 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.470635 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.471376 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.471463 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.471685 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.471773 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.471992 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472081 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472300 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472429 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472606 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472710 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.472938 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473028 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473251 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473348 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473559 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473657 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473861 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.473947 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474164 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474260 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474474 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474581 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474796 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.474886 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475104 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475191 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475404 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475500 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475711 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.475818 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476020 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476115 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476328 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476423 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476663 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476803 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.476995 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477087 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477311 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477427 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477614 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477716 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.477944 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478045 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478263 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478369 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478570 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478669 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.478893 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479010 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479224 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479321 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479541 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479639 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479861 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.479966 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480164 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480261 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480465 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480563 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480788 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.480899 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481093 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481190 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481407 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481505 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481712 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.481817 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482012 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482109 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482310 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482431 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482613 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482711 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.482912 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483009 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483211 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483315 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483510 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483615 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483808 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.483905 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484107 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484215 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484403 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484499 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484723 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.484821 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485022 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485120 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485316 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485412 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485613 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485700 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.485906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486002 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486234 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486320 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486537 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486632 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486836 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.486945 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487131 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487227 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487428 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487516 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487728 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.487829 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488028 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488125 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488333 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488429 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488647 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488739 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.488952 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489043 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489260 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489348 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489561 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489650 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489862 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.489949 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490175 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490268 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490492 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490584 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490802 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.490891 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491107 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491212 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491414 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491548 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491727 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.491816 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492029 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492127 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492331 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492417 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492649 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492741 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.492958 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493058 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493263 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493351 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493584 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493674 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493890 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.493986 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494190 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494277 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494496 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494583 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494804 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.494900 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495113 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495201 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495421 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495515 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495727 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.495815 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496050 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496137 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496352 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496438 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496680 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496772 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.496989 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497077 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497294 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497393 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497603 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497699 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.497908 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498002 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498210 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498367 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498514 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498603 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498822 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.498910 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499131 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499228 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499438 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499523 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499748 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.499837 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500050 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500144 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500358 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500446 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500690 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.500798 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501008 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501106 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501322 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501411 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501649 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501741 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.501996 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502092 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502301 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502605 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502691 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.502906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.503004 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.503147 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103664) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:08:49.503268 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.503580 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.503924 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.504250 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.504564 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.504897 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.505200 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:08:49.505443 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:08:49.657008 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO dbcounter [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Registered counter for database nova_api Aug 04 02:08:49.658841 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Registered counter for database nova_api Aug 04 02:08:49.677911 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_db.sqlalchemy.engines [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.679387 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.684693 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writer thread running {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.690432 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.742859 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.context [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a58f248-bef7-4521-9706-ce0d39f099a9(cell1) {{(pid=103664) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:08:49.746131 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.context [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a58f248-bef7-4521-9706-ce0d39f099a9(cell1) {{(pid=103665) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:08:49.746747 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_concurrency.lockutils [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:08:49.748323 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_concurrency.lockutils [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:08:49.749137 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_concurrency.lockutils [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:08:49.750062 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:08:49.751109 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_concurrency.lockutils [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103664) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:08:49.751642 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:08:49.752972 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:08:49.753618 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO dbcounter [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Registered counter for database nova_cell0 Aug 04 02:08:49.754965 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:08:49.756980 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Registered counter for database nova_cell0 Aug 04 02:08:49.759018 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO dbcounter [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Registered counter for database nova_cell1 Aug 04 02:08:49.762349 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Registered counter for database nova_cell1 Aug 04 02:08:49.768571 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_db.sqlalchemy.engines [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.770252 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_db.sqlalchemy.engines [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.770695 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.774482 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.776241 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.776353 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writer thread running {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.779052 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writer thread running {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.916203 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.921831 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO dbcounter [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Registered counter for database nova_cell0 Aug 04 02:08:49.925222 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Registered counter for database nova_cell0 Aug 04 02:08:49.929039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG oslo_db.sqlalchemy.engines [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103664) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.933463 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writer thread running {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:49.933653 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:08:49.938088 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:08:50.270352 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: WARNING keystonemiddleware.auth_token [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:08:50.273882 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:08:50.277696 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: WARNING keystonemiddleware.auth_token [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:08:50.281078 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:08:50.619166 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: WARNING keystonemiddleware.auth_token [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:08:50.620764 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:08:50.625070 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: WARNING keystonemiddleware.auth_token [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:08:50.626700 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:08:50.630333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d707a49c0 pid: 103664 (default app) Aug 04 02:08:50.631942 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563d707a49c0 pid: 103665 (default app) Aug 04 02:08:50.632374 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:08:50.633578 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-6c88438a-e917-4e78-aae7-588edc6e1cac None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Aug 04 02:08:50.633983 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Thu Aug 4 02:08:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:07.641797 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:07.643640 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002668 Aug 04 02:10:07.649419 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:07.655602 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_api:SELECT=3 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:07.657270 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_cell1:SELECT=3 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:07.659146 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_cell0:SELECT=3 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:07.660192 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:08.550994 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-e963288d-577e-4c06-82ac-ffb9147bef9b admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:08.583964 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-e963288d-577e-4c06-82ac-ffb9147bef9b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933278 Aug 04 02:10:08.584837 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1292 bytes} [Thu Aug 4 02:10:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:10:10.818367 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:10.819475 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-8e0a4ecb-9ad2-4396-bd59-efa49a34d50b None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 04 02:10:10.824900 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:11.305094 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-e25d8440-e0bb-4cee-aef0-c34bf941229a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "vcpus": 1}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:11.326475 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:10:11.326475 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: warnings.warn(msg) Aug 04 02:10:11.354243 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-e25d8440-e0bb-4cee-aef0-c34bf941229a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528128 Aug 04 02:10:11.354984 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:10:11.368642 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:11.369777 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:11.370770 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:11.371487 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:11.571948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1217c45c-b9ed-4c82-836a-2ca78e0597df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:11.576290 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:10:11.576290 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:10:11.643275 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1217c45c-b9ed-4c82-836a-2ca78e0597df admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279685 Aug 04 02:10:11.644182 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1336 bytes} [Thu Aug 4 02:10:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:13.921387 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-e25d8440-e0bb-4cee-aef0-c34bf941229a admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:13.922373 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-e25d8440-e0bb-4cee-aef0-c34bf941229a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 04 02:10:13.922952 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:14.671443 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4c60b4b3-8cc2-4a04-9da0-bcff3173957c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "id": "d1", "vcpus": 1}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:14.691252 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:10:14.691252 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:10:14.716972 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4c60b4b3-8cc2-4a04-9da0-bcff3173957c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.787283 Aug 04 02:10:14.718302 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:10:14.737903 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-aa27c413-0328-4339-95ed-c7cae08f5d1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:14.742694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:10:14.742694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: warnings.warn(msg) Aug 04 02:10:14.782618 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-aa27c413-0328-4339-95ed-c7cae08f5d1d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051573 Aug 04 02:10:14.791077 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1336 bytes} [Thu Aug 4 02:10:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:17.205814 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4c60b4b3-8cc2-4a04-9da0-bcff3173957c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:17.205814 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4c60b4b3-8cc2-4a04-9da0-bcff3173957c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 04 02:10:17.205814 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:17.585337 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d026d446-24ec-4552-9ed0-7b8fc15b3df9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "disk": 10, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:17.606200 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d026d446-24ec-4552-9ed0-7b8fc15b3df9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.395185 Aug 04 02:10:17.607187 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:10:17.623049 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e5d1c7e4-b328-41c7-a919-0a8c2066b5da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:17.647969 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e5d1c7e4-b328-41c7-a919-0a8c2066b5da admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031944 Aug 04 02:10:17.649056 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1336 bytes} [Thu Aug 4 02:10:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:19.841671 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d026d446-24ec-4552-9ed0-7b8fc15b3df9 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:19.842696 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d026d446-24ec-4552-9ed0-7b8fc15b3df9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 02:10:19.843091 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:20.268922 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-c990f0b2-c307-470d-8e3e-8b7b1ded81f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:20.295408 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-c990f0b2-c307-470d-8e3e-8b7b1ded81f6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445246 Aug 04 02:10:20.295965 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:10:20.308426 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-690ce6e9-f7b7-455e-a5d3-0779dbdfd427 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:20.339318 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-690ce6e9-f7b7-455e-a5d3-0779dbdfd427 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034487 Aug 04 02:10:20.340227 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1336 bytes} [Thu Aug 4 02:10:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:10:22.630043 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-c990f0b2-c307-470d-8e3e-8b7b1ded81f6 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:22.631115 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-c990f0b2-c307-470d-8e3e-8b7b1ded81f6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 04 02:10:22.631467 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:10:23.061686 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:23.084420 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446202 Aug 04 02:10:23.085271 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:10:23.097499 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-70e4c39c-3c5c-4f43-ad25-1a135494652e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:23.122874 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-70e4c39c-3c5c-4f43-ad25-1a135494652e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029372 Aug 04 02:10:23.130565 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1336 bytes} [Thu Aug 4 02:10:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:25.559544 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:25.560878 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Aug 04 02:10:25.561434 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:26.030349 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3693b071-7e3e-4b29-9729-f06daf8adab5 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:26.056159 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3693b071-7e3e-4b29-9729-f06daf8adab5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487086 Aug 04 02:10:26.056759 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1292 bytes} [Thu Aug 4 02:10:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:10:28.363450 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:28.364467 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-b89f62fa-c0f2-413a-b544-0f719aa30873 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 04 02:10:28.364912 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:28.829634 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-6caea37a-2f3c-485a-826c-3946a026d933 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:28.852204 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-6caea37a-2f3c-485a-826c-3946a026d933 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480860 Aug 04 02:10:28.852812 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:10:28.865478 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-89eba211-94a7-4a59-9188-5a96b0a5b342 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:28.891265 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-89eba211-94a7-4a59-9188-5a96b0a5b342 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029420 Aug 04 02:10:28.892105 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1333 bytes} [Thu Aug 4 02:10:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:31.394469 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-6caea37a-2f3c-485a-826c-3946a026d933 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:31.395491 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-6caea37a-2f3c-485a-826c-3946a026d933 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 02:10:31.395893 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:31.796635 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d3bf28d6-6979-46fc-a01c-ea0a4a08645b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:31.816030 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d3bf28d6-6979-46fc-a01c-ea0a4a08645b admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414009 Aug 04 02:10:31.816731 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:10:31.829850 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-129cae52-11c1-4d02-8e99-d963b929f3db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:31.853809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-129cae52-11c1-4d02-8e99-d963b929f3db admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028330 Aug 04 02:10:31.854553 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1333 bytes} [Thu Aug 4 02:10:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:34.092101 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d3bf28d6-6979-46fc-a01c-ea0a4a08645b admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:34.093189 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d3bf28d6-6979-46fc-a01c-ea0a4a08645b admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 04 02:10:34.093600 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:34.521343 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-27585c22-4cf7-4248-91ad-051a0acd854c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:34.546438 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-27585c22-4cf7-4248-91ad-051a0acd854c admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445687 Aug 04 02:10:34.549140 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:10:34.559244 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-82a6cc40-8a67-46e7-8b7b-59e407055256 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:34.589987 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-82a6cc40-8a67-46e7-8b7b-59e407055256 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034597 Aug 04 02:10:34.591191 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1333 bytes} [Thu Aug 4 02:10:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:36.888427 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-27585c22-4cf7-4248-91ad-051a0acd854c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:36.889530 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-27585c22-4cf7-4248-91ad-051a0acd854c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 04 02:10:36.892054 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:37.337786 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-a171454e-621f-43b7-afa6-1207d7051263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "id": "4"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:37.358457 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-a171454e-621f-43b7-afa6-1207d7051263 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462185 Aug 04 02:10:37.359133 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:10:37.371165 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-873d2bff-dd09-46f6-aae0-be82f61dc504 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:37.397779 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-873d2bff-dd09-46f6-aae0-be82f61dc504 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030245 Aug 04 02:10:37.398639 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1333 bytes} [Thu Aug 4 02:10:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:10:39.679128 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-a171454e-621f-43b7-afa6-1207d7051263 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:39.680825 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-a171454e-621f-43b7-afa6-1207d7051263 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Aug 04 02:10:39.681447 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:40.151280 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "id": "5"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:40.175184 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.487307 Aug 04 02:10:40.176073 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1283 bytes} [Thu Aug 4 02:10:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:10:40.187831 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-c5819b33-10d8-4374-a95a-e96628502c93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:10:40.197320 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:10:40.216143 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-c5819b33-10d8-4374-a95a-e96628502c93 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031980 Aug 04 02:10:40.216915 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1333 bytes} [Thu Aug 4 02:10:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:10:59.853259 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:10:59.854741 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Aug 04 02:10:59.855408 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:10:59.866799 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:11:00.245440 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-e47801f2-2810-4615-b48e-c338c43bb708 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:00.264081 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-e47801f2-2810-4615-b48e-c338c43bb708 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401709 Aug 04 02:11:00.264544 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1292 bytes} [Thu Aug 4 02:10:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:01.334938 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:01.335948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-86a5359c-d662-4f45-a9d5-f951da16cf8a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 04 02:11:01.336347 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:01.858078 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-644d6662-0716-4f7e-a5ae-2a747427829f admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:01.863739 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.wsgi [None req-644d6662-0716-4f7e-a5ae-2a747427829f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-644d6662-0716-4f7e-a5ae-2a747427829f admin admin] Request method failure captured: Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept: application/json Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept-Encoding: gzip, deflate Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Connection: keep-alive Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Content-Length: 0 Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Host: 10.222.0.45 Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-System-Scope: None Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: User-Agent: python-novaclient Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Auth-Token: gAAAAABi6yq1xxP0SCbLQiCRx8qM1Msi2uAwecht1tXKejlvfo3EJr3NYeznooh1_FM3Ijr3bfo4W7om0-XjSdFigcmWHlmb9zhK7Ani7u_2gTigRso1Kc-SIMXpQq0rn3-Zb-2kodoH8O1d7isAxmg0pvOsQRPKlJ_94uFRC8Uny-mAu1GU2Os Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Id: None Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Name: None Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Identity-Status: Confirmed Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Is-Admin-Project: True Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Id: default Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Name: Default Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Name: admin Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Role: member,admin,reader Aug 04 02:11:01.866998 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Roles: member,admin,reader Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant: admin Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Name: admin Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User: admin Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Id: default Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Name: Default Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Name: admin Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: method: > Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: exception: Flavor 42 could not be found. Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: action_args: {'id': '42'} Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:01.868397 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:01.869368 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.870701 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-644d6662-0716-4f7e-a5ae-2a747427829f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:01.871964 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-644d6662-0716-4f7e-a5ae-2a747427829f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393342 Aug 04 02:11:01.871964 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Aug 4 02:11:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 02:11:01.878546 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1162f8c8-5811-4dff-98b1-288b27ae56a8 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:01.882732 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:11:01.902219 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1162f8c8-5811-4dff-98b1-288b27ae56a8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027614 Aug 04 02:11:01.902794 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:01.912689 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-b8ce89e7-c851-4a9b-998f-7df7d3b6d28c admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:01.936460 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-b8ce89e7-c851-4a9b-998f-7df7d3b6d28c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027367 Aug 04 02:11:01.937039 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:01.947181 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5fe766b5-3f08-4b9d-9006-f8ad20e61412 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:01.954184 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-5fe766b5-3f08-4b9d-9006-f8ad20e61412 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5fe766b5-3f08-4b9d-9006-f8ad20e61412 admin admin] Request method failure captured: Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept: application/json Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Connection: keep-alive Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Content-Length: 0 Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Host: 10.222.0.45 Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABi6yq1xxP0SCbLQiCRx8qM1Msi2uAwecht1tXKejlvfo3EJr3NYeznooh1_FM3Ijr3bfo4W7om0-XjSdFigcmWHlmb9zhK7Ani7u_2gTigRso1Kc-SIMXpQq0rn3-Zb-2kodoH8O1d7isAxmg0pvOsQRPKlJ_94uFRC8Uny-mAu1GU2Os Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Role: member,admin,reader Aug 04 02:11:01.957481 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Roles: member,admin,reader Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant: admin Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User: admin Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Name: admin Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: method: > Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: exception: Flavor 42 could not be found. Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: action_args: {'id': '42'} Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:01.958948 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:01.959749 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:01.960803 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5fe766b5-3f08-4b9d-9006-f8ad20e61412 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:01.961852 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-5fe766b5-3f08-4b9d-9006-f8ad20e61412 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015538 Aug 04 02:11:01.961852 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Aug 4 02:11:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:11:02.925931 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-b8ce89e7-c851-4a9b-998f-7df7d3b6d28c admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:02.926996 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-b8ce89e7-c851-4a9b-998f-7df7d3b6d28c admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 04 02:11:02.927395 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:03.450545 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a9ccac82-a339-409a-b95d-d09e0255d156 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:03.456800 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-a9ccac82-a339-409a-b95d-d09e0255d156 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a9ccac82-a339-409a-b95d-d09e0255d156 admin admin] Request method failure captured: Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept: application/json Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Connection: keep-alive Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Content-Length: 0 Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Host: 10.222.0.45 Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABi6yq2oT--8t3eHXxWSLRRT7zaeySy9R5lblYr8DZlmAm4oprVCyPmfnozFeEYuacsjQi8PNTaoIvmdqT__Q6n-gNluqUnOekMAqkFyd51lo_9KKY2F-jEVL0tZHrwlB23Se0RNO5_Kr_BzBBRABN9fDbVy5bFyYjw8RMSF18pD8SYW_M Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Role: member,admin,reader Aug 04 02:11:03.458484 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Roles: member,admin,reader Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant: admin Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User: admin Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Name: admin Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: method: > Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: exception: Flavor 84 could not be found. Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: action_args: {'id': '84'} Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:03.460305 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:03.461410 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.462925 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a9ccac82-a339-409a-b95d-d09e0255d156 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:03.464172 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-a9ccac82-a339-409a-b95d-d09e0255d156 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393951 Aug 04 02:11:03.464172 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Aug 4 02:11:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:11:03.469732 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-7f283799-bc49-47c0-ab3a-53b2aad33e5b admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:03.484446 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-7f283799-bc49-47c0-ab3a-53b2aad33e5b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018172 Aug 04 02:11:03.484931 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:03.494422 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e42950f9-a15c-4665-856a-c1ec18803650 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:03.509963 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e42950f9-a15c-4665-856a-c1ec18803650 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019110 Aug 04 02:11:03.510508 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:03.520356 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-50c8b51a-d95a-4854-a673-69f4a8dd48e0 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:03.525803 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.wsgi [None req-50c8b51a-d95a-4854-a673-69f4a8dd48e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-50c8b51a-d95a-4854-a673-69f4a8dd48e0 admin admin] Request method failure captured: Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept: application/json Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept-Encoding: gzip, deflate Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Connection: keep-alive Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Content-Length: 0 Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Host: 10.222.0.45 Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-System-Scope: None Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: User-Agent: python-novaclient Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Auth-Token: gAAAAABi6yq2oT--8t3eHXxWSLRRT7zaeySy9R5lblYr8DZlmAm4oprVCyPmfnozFeEYuacsjQi8PNTaoIvmdqT__Q6n-gNluqUnOekMAqkFyd51lo_9KKY2F-jEVL0tZHrwlB23Se0RNO5_Kr_BzBBRABN9fDbVy5bFyYjw8RMSF18pD8SYW_M Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Id: None Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Name: None Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Identity-Status: Confirmed Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Is-Admin-Project: True Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Id: default Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Name: Default Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Name: admin Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Role: member,admin,reader Aug 04 02:11:03.527334 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Roles: member,admin,reader Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant: admin Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Name: admin Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User: admin Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Id: default Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Name: Default Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Name: admin Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: method: > Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: exception: Flavor 84 could not be found. Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: action_args: {'id': '84'} Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:03.529333 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:03.530336 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:03.531694 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-50c8b51a-d95a-4854-a673-69f4a8dd48e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:03.533143 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-50c8b51a-d95a-4854-a673-69f4a8dd48e0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012573 Aug 04 02:11:03.533143 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Thu Aug 4 02:11:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:11:04.510269 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-e42950f9-a15c-4665-856a-c1ec18803650 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:04.511273 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-e42950f9-a15c-4665-856a-c1ec18803650 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 04 02:11:04.511667 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:05.049952 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-ad42972c-0663-4a99-9674-48498f6e3ba6 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:05.055637 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.wsgi [None req-ad42972c-0663-4a99-9674-48498f6e3ba6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-ad42972c-0663-4a99-9674-48498f6e3ba6 admin admin] Request method failure captured: Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept: application/json Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Accept-Encoding: gzip, deflate Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Connection: keep-alive Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Content-Length: 0 Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Host: 10.222.0.45 Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Openstack-System-Scope: None Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: User-Agent: python-novaclient Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Auth-Token: gAAAAABi6yq4iBg6ZPSByvqRHiHCAoSDgfCd30GAr0x-1OWR1jurmMqJMbzDT6uV0VAsK6MTklQ6c7gqko4M5wIcYpra6CZFAUX0qHMphqWIjV5MWQAHuacdoxXKvlTxUAjIIZ_yYsFrftT4IlGLu6mC0ekansudRyo_lDXU2O8p0KQU1JGPuvA Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Id: None Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Domain-Name: None Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Identity-Status: Confirmed Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Is-Admin-Project: True Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Id: default Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Domain-Name: Default Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Project-Name: admin Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Role: member,admin,reader Aug 04 02:11:05.057176 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Roles: member,admin,reader Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant: admin Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-Tenant-Name: admin Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User: admin Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Id: default Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Domain-Name: Default Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: X-User-Name: admin Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: method: > Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: exception: Flavor 451 could not be found. Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: action_args: {'id': '451'} Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:05.058676 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:05.059645 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.060791 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-ad42972c-0663-4a99-9674-48498f6e3ba6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:05.061826 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-ad42972c-0663-4a99-9674-48498f6e3ba6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408325 Aug 04 02:11:05.061826 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:11:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:11:05.068853 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3cfa9cef-9222-4890-b8c5-6ebd35dfdd49 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:05.083906 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3cfa9cef-9222-4890-b8c5-6ebd35dfdd49 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018652 Aug 04 02:11:05.084440 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:05.093688 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:05.108445 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018253 Aug 04 02:11:05.109002 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Thu Aug 4 02:11:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:11:05.118373 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5d818886-cb89-4f82-9dfd-f8e452c13a3b admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:05.123571 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-5d818886-cb89-4f82-9dfd-f8e452c13a3b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5d818886-cb89-4f82-9dfd-f8e452c13a3b admin admin] Request method failure captured: Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept: application/json Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Connection: keep-alive Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Content-Length: 0 Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Host: 10.222.0.45 Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABi6yq4iBg6ZPSByvqRHiHCAoSDgfCd30GAr0x-1OWR1jurmMqJMbzDT6uV0VAsK6MTklQ6c7gqko4M5wIcYpra6CZFAUX0qHMphqWIjV5MWQAHuacdoxXKvlTxUAjIIZ_yYsFrftT4IlGLu6mC0ekansudRyo_lDXU2O8p0KQU1JGPuvA Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Role: member,admin,reader Aug 04 02:11:05.125099 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Roles: member,admin,reader Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/457cd62a685649778d5130f3937b1bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant: admin Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 457cd62a685649778d5130f3937b1bcf Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User: admin Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Id: 1cdae040f69d4994bc484e82a80c2139 Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: X-User-Name: admin Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: method: > Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: exception: Flavor 451 could not be found. Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: action_args: {'id': '451'} Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:11:05.127372 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:05.128413 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Aug 04 02:11:05.129809 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-5d818886-cb89-4f82-9dfd-f8e452c13a3b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:11:05.131003 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-5d818886-cb89-4f82-9dfd-f8e452c13a3b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012185 Aug 04 02:11:05.131003 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:11:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 02:11:06.108473 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:06.109513 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 02:11:06.109935 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:06.629914 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-b700a2a2-bbdc-449d-8418-7c2e89aac578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:11:06.649160 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-b700a2a2-bbdc-449d-8418-7c2e89aac578 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401438 Aug 04 02:11:06.649741 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Aug 4 02:11:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:11:07.624564 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:07.626138 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 04 02:11:07.626531 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:08.153916 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-eb2f9d8c-45ee-4d44-9af9-e76106d20cc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:11:08.172049 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-eb2f9d8c-45ee-4d44-9af9-e76106d20cc7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408863 Aug 04 02:11:08.173136 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Aug 4 02:11:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:11:09.156028 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:09.157062 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 04 02:11:09.157450 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:09.706693 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-448d6645-621a-45a7-abda-7c9bde3f9958 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:11:09.725512 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-448d6645-621a-45a7-abda-7c9bde3f9958 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.430472 Aug 04 02:11:09.726047 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Aug 4 02:11:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:11:10.705939 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:10.706979 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 04 02:11:10.707378 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:11.354580 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-70f72ec0-4d51-4707-a7b7-dd45d62d5995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:11:11.373302 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-70f72ec0-4d51-4707-a7b7-dd45d62d5995 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.527196 Aug 04 02:11:11.373848 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Thu Aug 4 02:11:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:11:12.344887 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:12.345906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 04 02:11:12.346304 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:11:12.868643 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4b7bbba8-5e05-4a9f-ae37-b6bbfd777cdb admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:11:12.893326 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4b7bbba8-5e05-4a9f-ae37-b6bbfd777cdb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410308 Aug 04 02:11:12.893872 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Thu Aug 4 02:11:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:12:05.306893 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.307911 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-f300e5b6-263e-4d9f-8a8a-de1be34ece13 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 04 02:12:05.308305 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 931 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:12:05.319332 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:12:05.726316 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-517d33a0-6c7a-4c27-8445-b57a3a62d119 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.747020 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-517d33a0-6c7a-4c27-8445-b57a3a62d119 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.432119 Aug 04 02:12:05.747493 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1292 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:12:05.768514 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG dbcounter [-] [103664] Writing DB stats nova_api:SELECT=14 {{(pid=103664) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:12:05.772344 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-8aceb843-b7ff-48c1-ab67-0428849be668 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.780079 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-8aceb843-b7ff-48c1-ab67-0428849be668 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013028 Aug 04 02:12:05.780602 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1283 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:12:05.792680 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-7f7e9bf5-078e-4fc7-bee7-557c394eb253 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.800176 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-7f7e9bf5-078e-4fc7-bee7-557c394eb253 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011000 Aug 04 02:12:05.800713 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1286 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:12:05.811997 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.819603 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 Aug 04 02:12:05.820124 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1286 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:12:05.832307 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4fa747fa-8d40-4c21-926a-241fd21fd8bf admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:12:05.840053 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4fa747fa-8d40-4c21-926a-241fd21fd8bf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011874 Aug 04 02:12:05.840652 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1283 bytes} [Thu Aug 4 02:12:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:14:57.744259 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:14:57.745388 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 04 02:14:57.745781 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:14:57.890599 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=6 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:14:58.054270 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:14:58.056601 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:14:58.056601 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:14:58.057852 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:14:58.058338 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:14:58.059083 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:14:58.059512 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:14:58.093725 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-bb17c4a0-1b69-4f9c-85c5-3390a32f1d7c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204648 Aug 04 02:14:58.094296 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 35/70] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:14:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:14:58.936475 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:14:58.937516 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 04 02:14:58.937906 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:14:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:14:59.129348 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:14:59.131731 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:14:59.131731 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:14:59.132984 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:14:59.133422 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:14:59.134210 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:14:59.134628 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:14:59.158069 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-b87d5284-7e98-44bc-8d7e-7f704ed67321 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080200 Aug 04 02:14:59.158689 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 36/72] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:14:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:15:10.412175 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:15:10.413203 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 04 02:15:10.413590 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:15:10.557772 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:15:10.558500 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:15:10.559134 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=8 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:15:10.606617 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:15:10.608979 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:15:10.608979 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:15:10.610157 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:15:10.610597 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:15:10.611378 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:15:10.612293 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:15:10.637317 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-b366ddee-944f-4fc9-925c-cbd5218968d2 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083848 Aug 04 02:15:10.637883 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 37/74] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:15:10 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:15:11.469798 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: DEBUG nova.api.openstack.wsgi [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] Calling method '>' {{(pid=103664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:15:11.470856 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: INFO nova.api.openstack.requestlog [None req-d7ecacf6-9696-4318-80b1-341de4073d42 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 04 02:15:11.471944 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: [pid: 103664|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1074 bytes} [Thu Aug 4 02:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:15:11.664670 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:15:11.667068 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:15:11.667068 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Aug 04 02:15:11.668238 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:15:11.668708 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:15:11.669559 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:15:11.669988 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:15:11.692756 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-bdecad6a-8c90-4b49-a334-e13926b0eb61 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080564 Aug 04 02:15:11.693435 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Aug 4 02:15:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:16:08.845100 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: Thu Aug 4 02:16:08 2022 - graceful shutdown triggered... Aug 04 02:16:08.844847 dv-cinder-740146-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 02:16:08.846073 dv-cinder-740146-17-iscsi devstack@n-api.service[103664]: Gracefully killing worker 1 (pid: 103664)... Aug 04 02:16:08.846488 dv-cinder-740146-17-iscsi devstack@n-api.service[103665]: Gracefully killing worker 2 (pid: 103665)... Aug 04 02:16:09.845467 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: worker 1 buried after 1 seconds Aug 04 02:16:09.845997 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: worker 2 buried after 1 seconds Aug 04 02:16:09.845997 dv-cinder-740146-17-iscsi devstack@n-api.service[103663]: goodbye to uWSGI. Aug 04 02:16:09.846992 dv-cinder-740146-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 02:16:09.847542 dv-cinder-740146-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 02:16:09.850939 dv-cinder-740146-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 02:16:09.860334 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:16:09 2022] *** Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: nodename: dv-cinder-740146-17-iscsi Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: machine: x86_64 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: clock source: unix Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: pcre jit disabled Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: detected number of CPU cores: 4 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: current working directory: / Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: your processes number limit is 47680 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: your memory page size is 4096 bytes Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: detected max file descriptor number: 2048 Aug 04 02:16:09.862479 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: lock engine: pthread robust mutexes Aug 04 02:16:09.863459 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: thunder lock: enabled Aug 04 02:16:09.863459 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 02:16:09.863459 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:16:09.904327 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: Python main interpreter initialized at 0x56240f4e49c0 Aug 04 02:16:09.904327 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: python threads support enabled Aug 04 02:16:09.904327 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: your server socket listen backlog is limited to 100 connections Aug 04 02:16:09.904327 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:16:09.904965 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:16:09.904965 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: *** Operational MODE: preforking *** Aug 04 02:16:09.905188 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:16:09.905188 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: spawned uWSGI master process (pid: 118148) Aug 04 02:16:09.905319 dv-cinder-740146-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 02:16:09.905641 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: spawned uWSGI worker 1 (pid: 118167, cores: 1) Aug 04 02:16:09.905915 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: spawned uWSGI worker 2 (pid: 118168, cores: 1) Aug 04 02:16:09.906201 dv-cinder-740146-17-iscsi devstack@n-api.service[118148]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:16:10.572974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:16:10.599477 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 02:16:11.740215 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:16:11.740215 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: from cryptography.utils import int_from_bytes Aug 04 02:16:11.741336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:16:11.741336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: from cryptography.utils import int_from_bytes Aug 04 02:16:11.780290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:16:11.780290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: from cryptography.utils import int_from_bytes Aug 04 02:16:11.780908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:16:11.780908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: from cryptography.utils import int_from_bytes Aug 04 02:16:14.098286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:16:14.098845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:16:14.099064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:16:14.099435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:16:14.099723 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:16:14.100110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.100442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.100791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.101345 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.101685 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.102004 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.102331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.102661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.103048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.103256 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.103577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.103907 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-iscsi {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.104231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.104746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.105071 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.105539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.105734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.106025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.106336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.106846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.107503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.107619 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.107890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.108377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.108544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.108882 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.109205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.109516 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.109843 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.110156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.110560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-iscsi {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.110882 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.111198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.111519 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.111941 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.112259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.112573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.112927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.113255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.113566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.113895 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.114218 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.114541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.114865 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.115201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.115517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.115829 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.116152 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.116461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.116798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.117053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.117364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.117690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.118014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.118340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.118595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.118849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.119170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.119494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.119808 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.120121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.120430 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.120761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.121074 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.121383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.121694 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.122004 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.122325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.122646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.122971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.123283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.123604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.123999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.124254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.124563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.124934 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.125255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.125569 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.125888 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.126211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.126521 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.126834 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.127142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.127463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.127799 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.128106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.128359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.128750 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.129061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.129381 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.129689 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.130059 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.130308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.130612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.131438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.131746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.132054 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.132360 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.132691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.133002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.133309 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.133614 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.133918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.134237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.134548 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.134865 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.135175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.135477 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.135786 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.136108 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.136410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.136746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.137071 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.137378 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.137685 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.137999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.138308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.138614 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.138932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.139234 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.139541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.139858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.140168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.140475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.140569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:16:14.141027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.141116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:16:14.141206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.141397 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:16:14.141491 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.141690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.141785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:16:14.141991 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.142083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:16:14.142415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.142511 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.142598 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.142784 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.142901 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143021 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143219 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.143912 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144144 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.144887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.145129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.145221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.145444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.145543 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.145771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-17-iscsi {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.145870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.146096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.146207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.147076 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.147312 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.147400 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.147484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.147719 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.147860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.147958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.148057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.148250 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.148347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.148561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.148919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.148919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.149117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.149230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.149401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.149531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.149709 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.149856 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.150024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.150180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.150360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.150515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.150710 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.155795 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.155919 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.156123 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156200 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.156271 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156394 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.156493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.156690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.156885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-17-iscsi {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.156979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.157071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.157193 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.157278 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.157392 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.157487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.157567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.157666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.157994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.158226 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158313 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.158387 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.158526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158602 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.158689 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.158886 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.158971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.159087 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.159277 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.159380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.159466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.159549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.159631 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.159722 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.159814 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.159928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.160061 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.160156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.160243 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.160336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.160422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.160516 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.160602 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.160718 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.160800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.161116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161209 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.161293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.161461 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161543 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.161637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161727 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.161818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.161818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.162121 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162226 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.162311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.162492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162576 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.162668 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.162847 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.162938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.163110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.163283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.163461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.163638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.163806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.163911 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.164014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.164105 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.164201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.164285 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.164364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.164444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.164530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.164635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.164735 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.164827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.165042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.165194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.165358 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.165448 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.165677 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.165782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.165986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.166078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.166316 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.166406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.166634 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.166733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.166946 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.167044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.167260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.167442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.167568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.167665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.167881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.168029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.168200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.168324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.168496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.168637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.168840 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.168933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.169140 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.169239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.169389 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.169489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.169689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.169781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.169993 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.170094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.170307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.170399 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.170613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.170712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.170918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.171016 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.171221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.171335 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.171522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.171644 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.171826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.171974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.172129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.172302 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.172431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.172612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.172761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.172952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.173067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.173263 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.173354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.173576 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.173668 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.173886 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.173979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.174199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.174298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.174508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.174790 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.174884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.175114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.175201 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.175427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.175516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.175794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.175925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.176048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.176138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.176355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.176445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.176683 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.176780 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.176995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.177091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.177303 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.177412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.178373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.178479 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.178554 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.178738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.178834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.179070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.179261 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.179379 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.179688 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.179798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.180040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.180314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.180404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.180705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.180872 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.181171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.181399 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.181582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.181706 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.181871 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.182687 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.182801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.182801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.182943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.183019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.183096 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.183174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.183415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.183679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.183772 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.184020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.184289 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.184381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.185111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.185254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.185378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.185378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.185814 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.185936 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:16:14.185936 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.186166 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.186284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.186552 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.186747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.187017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.187356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.187480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.187695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.187968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.188077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.188600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.189737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.189850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.189850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.189994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190079 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190079 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190525 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.190974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.191086 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.191309 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.191560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.191684 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.191940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.192157 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.192270 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.192564 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.192792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.192985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.193376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.193968 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.194295 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.194405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.194615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.195009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.195122 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.195360 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.195635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.195728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196718 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.196829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.197036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.197135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.197353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.197453 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.197669 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.198507 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.198614 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.198700 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.198791 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.198907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.199000 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.199405 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.199500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.199838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200020 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200483 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.200946 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201256 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201883 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.201990 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202198 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202609 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.202930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203776 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.203868 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.204339 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.204432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.204746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.204846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.204985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205079 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205299 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.205918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206056 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206232 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.206879 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207047 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207200 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207677 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.207991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.208170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.208311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.208508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.208666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.208953 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209270 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209421 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.209891 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210783 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.210875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211092 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211182 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211720 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.211812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212374 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.212989 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.213081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.213892 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214170 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214513 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214513 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214734 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.214955 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215198 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215672 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.215914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.216849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.217916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.218038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.220744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.220881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.220965 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221756 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.221987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.222064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.222166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.222248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223440 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223904 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.223979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224055 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224278 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224882 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.224958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225115 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225193 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225402 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225470 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.225547 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.226652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.226813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.226971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227424 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.227884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.228070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.228306 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.228710 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.228883 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.229061 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.229400 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.229613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.229876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.230087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.230438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.230650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.230848 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.231159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.231363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.231517 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.231666 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.231842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.232048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.232262 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.233337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.233628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.233787 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.233949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234099 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234563 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234718 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.234887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235035 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235198 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235504 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.235971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.236148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.236307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.236474 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.236703 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.236862 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237023 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237648 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237797 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.237953 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.238111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.238260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.238462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.238630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.238956 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.239116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.239441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.239612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.239772 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.239947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.240697 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241004 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.241905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.242069 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.242231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.242401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.242551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.242725 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.243101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.243273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.243425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.243590 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.243939 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.244095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.244259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.244409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.244565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.244757 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.248492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.250209 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.251355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.251790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.251960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.252925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.253675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.253859 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254035 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254400 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.254976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.255148 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.255299 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.255449 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.255605 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.256547 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.256738 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.256918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257217 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.257887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258711 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.258871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259032 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259335 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259490 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.259953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.260110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.260267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.260442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.260950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.261121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.261283 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.261460 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.261610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.261787 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262646 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262795 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.262953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.263101 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.263491 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.263656 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.263827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.263984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264455 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.264932 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.265187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.265343 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.265492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.265649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.265810 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266161 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266318 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266633 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.266958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267275 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267587 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.267914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268576 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.268911 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269517 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269671 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.269987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.270137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.270293 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.270451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.270607 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271598 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.271910 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.272084 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.272334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.272579 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.272776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.272937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.273100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.273263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.273263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.273804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.273804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274251 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274411 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.274743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275792 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.275792 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.276900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.277091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.277373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.277544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.277725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.278112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.278305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.278461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.278660 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.278871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279195 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279343 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279819 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.279968 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.280124 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.280272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.280420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.280570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.280883 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281631 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281793 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.281950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.282252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.282505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.282671 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.282820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.282979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.283143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.283294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.283443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.283835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.283999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.284178 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.284336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.284493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.284674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.285409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.286153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.286338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.286499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.286649 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.286798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287822 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.287822 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.288114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.288281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.288438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.288587 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.288857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289179 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.289920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290692 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290848 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.290997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.291459 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.291617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.291775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.291925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.292114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.292326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.292493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.292663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.292919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.293729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.294303 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.294466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.294624 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.294774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.294922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295227 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295836 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.295991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.296158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.296515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.296736 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.296983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297605 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.297964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.298182 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.298337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.298495 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.298654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.298813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299192 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.299994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.300152 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.300357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.300547 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.300749 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.300980 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.301133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.301794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.302007 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.302182 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.302334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.302498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.303358 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.303516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.303675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.303835 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.304341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.304507 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.304702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.304873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305649 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.305978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.306098 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.306286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.306714 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.306874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.307996 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.308210 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.308333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.308481 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.308672 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.308840 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.309722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.309885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310232 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310597 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.310906 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.311055 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.311210 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.311408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.312486 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.312725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.312906 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.313068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.313224 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.313402 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.313712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.313877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.314027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.314507 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.314705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.314870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315020 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315698 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.315851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.316001 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.316149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.316307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.316456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.316890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317693 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.317859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.318018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.318313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.318992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.319199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.319351 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.319515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.319672 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.319853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320312 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.320816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.321007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.321161 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.321323 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.321482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.321631 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322177 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322765 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.322927 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.323123 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.323286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.323286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.323587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.323755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.324027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.324181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.324354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.324862 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.325954 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.326145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.326306 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.326456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.326605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.326890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.327973 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.328120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.328269 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.328424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.328580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.328782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.329238 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.329401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.329551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.329698 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.329860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330020 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.330941 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331588 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.331937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.332399 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.332563 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.332831 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333003 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333178 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333633 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.333789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.334311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.334488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.334908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335711 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.335873 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.336030 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.336180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.336338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.336486 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.336683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.337368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.337535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.337694 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.337860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.338962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339122 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.339834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340123 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340273 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340421 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340809 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.340982 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.341262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.341433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.341610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.341771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.341771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.342144 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.342470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.342630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.342812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343044 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343513 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.343926 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.344091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.344248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.344508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.344693 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.345993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.346954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.347194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.347472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.347633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.347782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348039 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348533 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348762 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.348916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349465 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349659 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.349979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350434 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.350754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351327 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.351856 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.352015 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.352015 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.352325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.352694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.352860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353270 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.353866 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354017 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354796 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.354982 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.355458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.355623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.355992 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.356149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.356307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.356466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.356771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.356991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.357174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.357424 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.357714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.357873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358104 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358317 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358471 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358801 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.358952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.359108 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.359267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.363606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.364703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.364873 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.365028 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.365790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.365790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.366219 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.366370 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.366519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.366669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.366868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.367019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.368562 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369107 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.369921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370421 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.370929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371411 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.371893 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372062 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372212 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372748 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.372945 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.373111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.373261 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.373435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.373602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.373764 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.374259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.374435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.374590 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.374739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.374888 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375090 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375256 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.375871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.376874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.377034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.377273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.378258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.378431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.378583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.378733 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.378897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379256 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379601 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379759 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.379918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.380118 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.380279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.380493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.380831 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.381492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.381658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.381814 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.381964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.382119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.382900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383525 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383601 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.383925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.384044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385268 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385422 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385586 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.385894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.386065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.386379 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.386546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.386733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.386733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.387022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.387179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.387380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.388034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.388248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.388405 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.388566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.388812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.389010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.389178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.389178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.389865 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390335 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.390859 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391527 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.391989 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.392145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.392145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.392444 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.392594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.392771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.393293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.393454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.393620 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.393794 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.393946 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394571 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.394910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.395338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.395496 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.395655 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.395815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.395965 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.396140 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397193 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397656 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.397830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.398018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.398171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.398340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.399535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.399741 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.399938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400265 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.400964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401148 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401638 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.401945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402108 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.402856 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403202 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403514 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.403821 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404093 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.404971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.405392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.405554 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.405705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.405853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406010 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406010 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.406948 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407097 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407586 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407740 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.407889 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.408046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.408196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.408356 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.408528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409097 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409268 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409588 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.409897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410266 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.410974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.411148 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.411313 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.411514 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.411677 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.411838 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.412681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.412845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.413840 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414006 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414165 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414483 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.414951 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.415099 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.415248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.415695 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.415857 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.416871 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417640 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417799 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.417959 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.418124 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.418273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.418422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.418571 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.418731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.419297 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.419462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.419612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.419772 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.419922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420085 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.420406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.421727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.422938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.424357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.425869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.427043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.428274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.429887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.431222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.432368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.433590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:16:14.434765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:16:14.533291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO dbcounter [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Registered counter for database nova_api Aug 04 02:16:14.554014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_db.sqlalchemy.engines [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.561069 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writer thread running {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.565917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO dbcounter [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Registered counter for database nova_api Aug 04 02:16:14.586229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_db.sqlalchemy.engines [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.592805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writer thread running {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.619135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.context [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a58f248-bef7-4521-9706-ce0d39f099a9(cell1) {{(pid=118167) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:16:14.623310 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:16:14.624929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:16:14.625781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:16:14.627798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:16:14.629819 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO dbcounter [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Registered counter for database nova_cell0 Aug 04 02:16:14.633928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO dbcounter [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Registered counter for database nova_cell1 Aug 04 02:16:14.641132 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_db.sqlalchemy.engines [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.642518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_db.sqlalchemy.engines [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.650188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writer thread running {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.650354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.context [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a58f248-bef7-4521-9706-ce0d39f099a9(cell1) {{(pid=118168) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 02:16:14.650532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writer thread running {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.654441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:16:14.656079 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:16:14.656944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:16:14.658967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:16:14.660998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO dbcounter [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Registered counter for database nova_cell0 Aug 04 02:16:14.665846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO dbcounter [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Registered counter for database nova_cell1 Aug 04 02:16:14.672939 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_db.sqlalchemy.engines [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.674723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_db.sqlalchemy.engines [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.680974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writer thread running {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.683622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writer thread running {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.799283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO dbcounter [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Registered counter for database nova_cell0 Aug 04 02:16:14.806395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_db.sqlalchemy.engines [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.811112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writer thread running {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:14.834430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO dbcounter [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Registered counter for database nova_cell0 Aug 04 02:16:14.842149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_db.sqlalchemy.engines [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:16:14.846601 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writer thread running {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:16:15.134022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: WARNING keystonemiddleware.auth_token [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:16:15.141379 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: WARNING keystonemiddleware.auth_token [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:16:15.166340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: WARNING keystonemiddleware.auth_token [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:16:15.173670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: WARNING keystonemiddleware.auth_token [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:16:15.491056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: WARNING keystonemiddleware.auth_token [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:16:15.497056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: WARNING keystonemiddleware.auth_token [None req-4016f843-6381-44c3-98ba-aa06bda52a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:16:15.503346 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56240f4e49c0 pid: 118167 (default app) Aug 04 02:16:15.518641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: WARNING keystonemiddleware.auth_token [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 02:16:15.525323 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: WARNING keystonemiddleware.auth_token [None req-945fe09d-d0d4-40b9-bd47-5980010f6327 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 02:16:15.531584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56240f4e49c0 pid: 118168 (default app) Aug 04 02:16:51.775415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:51.780449 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:51.782642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:51.784880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:52.829339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1571292e-48ca-4c23-93ae-c756ecb01487 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Action: 'create', calling method: .version_select at 0x7ff4956cbd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-850808984"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:16:54.088494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1571292e-48ca-4c23-93ae-c756ecb01487 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.329461 Aug 04 02:16:54.090368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1155 bytes} [Thu Aug 4 02:16:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2334 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 02:16:54.106302 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-606c3bc8-b861-45d3-b040-b86ccd35b2c9 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495599b80>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:54.254638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-606c3bc8-b861-45d3-b040-b86ccd35b2c9 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 200 len: 344 microversion: 2.1 time: 0.154160 Aug 04 02:16:54.262972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:16:54 2022] GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:54.320648 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2ed9edc0-c27a-425b-91c2-83abb0adc777 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff4957848b0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:54.375468 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:54.377592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:54.378848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:54.379834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:16:54.933154 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2ed9edc0-c27a-425b-91c2-83abb0adc777 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/17cdabd3-94ae-4d31-a919-236fcd865e88" status: 200 len: 351 microversion: 2.1 time: 1.101258 Aug 04 02:16:54.933737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 1/3] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:16:53 2022] GET /compute/v2.1/os-volumes/17cdabd3-94ae-4d31-a919-236fcd865e88 => generated 351 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:55.274353 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c4accaa0-79f7-480a-86a9-036d2760182f tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553a280>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:55.375642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c4accaa0-79f7-480a-86a9-036d2760182f tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 200 len: 345 microversion: 2.1 time: 0.110477 Aug 04 02:16:55.384807 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:16:55 2022] GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:55.409128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3087e0d0-3bdb-4381-b18a-dcfeacb009b9 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Action: 'create', calling method: .version_select at 0x7ff4955d6af0>, body: {"snapshot": {"volume_id": "2a7d1173-3278-4174-9cca-0935cbf7b93f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-40065167"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:16:56.102995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3087e0d0-3bdb-4381-b18a-dcfeacb009b9 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.713609 Aug 04 02:16:56.115431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 2/5] 10.222.0.45 () {60 vars in 1162 bytes} [Thu Aug 4 02:16:55 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:56.137285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-61e16558-680e-43cf-9281-3c051c82c7d1 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553a940>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:56.274805 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-61e16558-680e-43cf-9281-3c051c82c7d1 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 285 microversion: 2.1 time: 0.154856 Aug 04 02:16:56.275799 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 4/6] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:56 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:56.286372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-76d15bc7-b2e3-47d0-b67e-76fc3b39ca92 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49559c790>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:56.363510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-76d15bc7-b2e3-47d0-b67e-76fc3b39ca92 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.070020 Aug 04 02:16:56.363510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 3/7] 10.222.0.45 () {58 vars in 1140 bytes} [Thu Aug 4 02:16:56 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:56.375143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2809ae4c-9a4c-412f-8aec-b87d22fa4475 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495599d30>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:56.422847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2809ae4c-9a4c-412f-8aec-b87d22fa4475 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 285 microversion: 2.1 time: 0.051527 Aug 04 02:16:56.424211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 5/8] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:56 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:56.931392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-81eb0c2e-8eff-4a51-83dc-38a053a8a115 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff49559c8b0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:57.022086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-81eb0c2e-8eff-4a51-83dc-38a053a8a115 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d49c6848-8b2e-4864-ba94-0fa2f4203989" status: 200 len: 350 microversion: 2.1 time: 0.092682 Aug 04 02:16:57.023347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 4/9] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:16:56 2022] GET /compute/v2.1/os-volumes/d49c6848-8b2e-4864-ba94-0fa2f4203989 => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:57.438256 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5ef8d75b-478c-487d-a7f9-38942e944e7e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553aaf0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:57.527942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5ef8d75b-478c-487d-a7f9-38942e944e7e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 285 microversion: 2.1 time: 0.086508 Aug 04 02:16:57.527942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 6/10] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:57 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:58.531438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-149473b6-6110-43d3-a2dd-7ac784e5e98a tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495ead1f0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:58.572829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-149473b6-6110-43d3-a2dd-7ac784e5e98a tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 285 microversion: 2.1 time: 0.045197 Aug 04 02:16:58.573387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 5/11] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:58 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 285 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:59.589899 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f843f71e-5e78-4a65-90ec-b35bfa786761 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553a310>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:59.634616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f843f71e-5e78-4a65-90ec-b35bfa786761 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 286 microversion: 2.1 time: 0.052915 Aug 04 02:16:59.635394 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:59 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:59.660826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b187fa52-f1c9-4a9d-8eb1-124c32c1526b tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495537700>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:59.788874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47ad3eb0-9f84-4aea-b405-e754d313a187 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff49553a1f0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:59.810392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b187fa52-f1c9-4a9d-8eb1-124c32c1526b tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 202 len: 0 microversion: 2.1 time: 0.167643 Aug 04 02:16:59.810950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 6/13] 10.222.0.45 () {58 vars in 1254 bytes} [Thu Aug 4 02:16:59 2022] DELETE /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:16:59.819033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ae73873b-ca34-4a25-aa89-f8cc955bf623 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49559ce50>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:16:59.908147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-47ad3eb0-9f84-4aea-b405-e754d313a187 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/36f17536-0619-4a58-81bc-db0f3ad540e7" status: 200 len: 351 microversion: 2.1 time: 0.119837 Aug 04 02:16:59.908320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ae73873b-ca34-4a25-aa89-f8cc955bf623 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 200 len: 285 microversion: 2.1 time: 0.086707 Aug 04 02:16:59.908320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 7/15] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:16:59 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:16:59.908567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:16:59 2022] GET /compute/v2.1/os-volumes/36f17536-0619-4a58-81bc-db0f3ad540e7 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:16:59.918761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-19202b88-5d85-40db-8db4-f42ae8397db4 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff49559cca0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.135958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-19202b88-5d85-40db-8db4-f42ae8397db4 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.221374 Aug 04 02:17:00.136530 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1134 bytes} [Thu Aug 4 02:16:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:00.151013 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ae4f1d57-e431-4e95-9621-c8c08e18f35b tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff49553a670>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.353890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ae4f1d57-e431-4e95-9621-c8c08e18f35b tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207192 Aug 04 02:17:00.354726 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 9/17] 10.222.0.45 () {58 vars in 1149 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:00.368652 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-274e86a0-4301-4857-b570-6429ae32462d tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff4955411f0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.542886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-274e86a0-4301-4857-b570-6429ae32462d tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.178734 Aug 04 02:17:00.547437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 9/18] 10.222.0.45 () {58 vars in 1134 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:00.561431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7e1fbd4e-33e6-41f0-91aa-d3ba4787f355 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff4955334c0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.761903 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7e1fbd4e-33e6-41f0-91aa-d3ba4787f355 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.204750 Aug 04 02:17:00.762456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 10/19] 10.222.0.45 () {58 vars in 1167 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:00.776325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-599ef872-f7e1-46de-a4b3-8b2d70473bf0 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff495541a60>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.918505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c9d4bab8-95f1-43f4-90d0-6d46182ad3dd tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553ab80>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:00.958238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-c9d4bab8-95f1-43f4-90d0-6d46182ad3dd tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] HTTP exception thrown: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. Aug 04 02:17:00.962813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-599ef872-f7e1-46de-a4b3-8b2d70473bf0 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.184436 Aug 04 02:17:00.972353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 10/20] 10.222.0.45 () {58 vars in 1170 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c9d4bab8-95f1-43f4-90d0-6d46182ad3dd tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Request method failure captured: Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 HTTP/1.1 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywTpaJkEFB8NVhMSYcwtxS6xaLRs5cj_N_hSBthcfiw30CPTPBcJ1pgzWdovcTLeLUwvPmQi-et6nSeR0I8FzF1y-SvM4Tj6NYFtzWAA1-3fFwbk-Y2SmE-Jv4mHrE7OaW4YpcAAQJMxEt4eMk9O9z2wYYP92KdDzI6f6d6wM79sEU Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:17:00.972463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 1328d755f6914570b51181fdecefdc7c Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'a15d18bb-60d4-4d69-b375-83806bfec5f0'} Aug 04 02:17:00.973638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. (HTTP 404) (Request-ID: req-1991e32c-60cf-4987-b3ab-41c3099c779b) Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.974304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:00.975194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 02:17:00.976374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c9d4bab8-95f1-43f4-90d0-6d46182ad3dd tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Returning 404 to user: Snapshot a15d18bb-60d4-4d69-b375-83806bfec5f0 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c9d4bab8-95f1-43f4-90d0-6d46182ad3dd tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0" status: 404 len: 111 microversion: 2.1 time: 0.052645 Aug 04 02:17:00.978347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1251 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-snapshots/a15d18bb-60d4-4d69-b375-83806bfec5f0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:17:00.983389 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b2e7e24d-32c4-40c5-b1aa-660d3fd55f0a tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495537280>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:01.000286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4927ffaa-eb44-4cc8-bc5e-d17385656b07 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff495ead1f0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:01.161017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b2e7e24d-32c4-40c5-b1aa-660d3fd55f0a tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 202 len: 0 microversion: 2.1 time: 0.187076 Aug 04 02:17:01.174913 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 11/22] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:17:00 2022] DELETE /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:17:01.185084 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7fa6dba4-cdee-47e3-8354-7e459cbecfe3 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495537af0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:01.192889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4927ffaa-eb44-4cc8-bc5e-d17385656b07 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.217926 Aug 04 02:17:01.194019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1155 bytes} [Thu Aug 4 02:17:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:01.211654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eef93f32-086c-4cb3-87a1-bb5dc1e80d56 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff49553ac10>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:01.305726 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7fa6dba4-cdee-47e3-8354-7e459cbecfe3 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 200 len: 344 microversion: 2.1 time: 0.129318 Aug 04 02:17:01.313423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:17:01 2022] GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:01.394032 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-eef93f32-086c-4cb3-87a1-bb5dc1e80d56 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.189151 Aug 04 02:17:01.396410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1188 bytes} [Thu Aug 4 02:17:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:01.425295 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bcdf5f00-7ca7-4c21-a7ca-e6ed733e5cc1 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] Calling method '.version_select at 0x7ff495537430>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:01.756214 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bcdf5f00-7ca7-4c21-a7ca-e6ed733e5cc1 tempest-VolumesTestJSON-518999298 tempest-VolumesTestJSON-518999298-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.349934 Aug 04 02:17:01.768671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1155 bytes} [Thu Aug 4 02:17:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:02.331197 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d430fc91-6bb8-4b32-9e57-3e1624e725ef tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff49553f1f0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:02.400172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-d430fc91-6bb8-4b32-9e57-3e1624e725ef tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] HTTP exception thrown: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d430fc91-6bb8-4b32-9e57-3e1624e725ef tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Request method failure captured: Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f HTTP/1.1 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywTpaJkEFB8NVhMSYcwtxS6xaLRs5cj_N_hSBthcfiw30CPTPBcJ1pgzWdovcTLeLUwvPmQi-et6nSeR0I8FzF1y-SvM4Tj6NYFtzWAA1-3fFwbk-Y2SmE-Jv4mHrE7OaW4YpcAAQJMxEt4eMk9O9z2wYYP92KdDzI6f6d6wM79sEU Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:17:02.407427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 1328d755f6914570b51181fdecefdc7c Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '2a7d1173-3278-4174-9cca-0935cbf7b93f'} Aug 04 02:17:02.408818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. (HTTP 404) (Request-ID: req-fc54681f-0354-496f-b63f-32e2491914cf) Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.409500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:02.410863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:17:02.411753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d430fc91-6bb8-4b32-9e57-3e1624e725ef tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Returning 404 to user: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:17:02.412667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d430fc91-6bb8-4b32-9e57-3e1624e725ef tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 404 len: 109 microversion: 2.1 time: 0.081105 Aug 04 02:17:02.419558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:17:02 2022] GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:17:02.427842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-72844676-3239-49e7-b5eb-712b1e961855 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495541700>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:02.501427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-72844676-3239-49e7-b5eb-712b1e961855 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] HTTP exception thrown: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-72844676-3239-49e7-b5eb-712b1e961855 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Request method failure captured: Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f HTTP/1.1 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywTpaJkEFB8NVhMSYcwtxS6xaLRs5cj_N_hSBthcfiw30CPTPBcJ1pgzWdovcTLeLUwvPmQi-et6nSeR0I8FzF1y-SvM4Tj6NYFtzWAA1-3fFwbk-Y2SmE-Jv4mHrE7OaW4YpcAAQJMxEt4eMk9O9z2wYYP92KdDzI6f6d6wM79sEU Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:17:02.505634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 1328d755f6914570b51181fdecefdc7c Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '2a7d1173-3278-4174-9cca-0935cbf7b93f'} Aug 04 02:17:02.506950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. (HTTP 404) (Request-ID: req-ac0611e0-76ee-4d43-a2b3-4595be68cdbb) Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.507613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:17:02.510301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:17:02.511617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.512736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.515459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-72844676-3239-49e7-b5eb-712b1e961855 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Returning 404 to user: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:17:02.521828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-72844676-3239-49e7-b5eb-712b1e961855 tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 404 len: 109 microversion: 2.1 time: 0.103466 Aug 04 02:17:02.526344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 14/28] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:17:02 2022] DELETE /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:17:02.539223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-95c83851-ddd1-43f5-9aaa-cdceb8ce275e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Calling method '.version_select at 0x7ff495512b80>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:02.615242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-95c83851-ddd1-43f5-9aaa-cdceb8ce275e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] HTTP exception thrown: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-95c83851-ddd1-43f5-9aaa-cdceb8ce275e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Request method failure captured: Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f HTTP/1.1 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywTpaJkEFB8NVhMSYcwtxS6xaLRs5cj_N_hSBthcfiw30CPTPBcJ1pgzWdovcTLeLUwvPmQi-et6nSeR0I8FzF1y-SvM4Tj6NYFtzWAA1-3fFwbk-Y2SmE-Jv4mHrE7OaW4YpcAAQJMxEt4eMk9O9z2wYYP92KdDzI6f6d6wM79sEU Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:17:02.618704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1ccd522731d34716b2f806e4e51ba8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1ccd522731d34716b2f806e4e51ba8e3 Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-704822454 Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 1328d755f6914570b51181fdecefdc7c Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-704822454-project Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '2a7d1173-3278-4174-9cca-0935cbf7b93f'} Aug 04 02:17:02.619858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. (HTTP 404) (Request-ID: req-efbbb168-6a27-4efc-a145-66a6c0c1c6ab) Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.620696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:17:02.621610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:17:02.622497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. Aug 04 02:17:02.623336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:17:02.624830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-95c83851-ddd1-43f5-9aaa-cdceb8ce275e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] Returning 404 to user: Volume 2a7d1173-3278-4174-9cca-0935cbf7b93f could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:17:02.625880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-95c83851-ddd1-43f5-9aaa-cdceb8ce275e tempest-VolumesSnapshotsTestJSON-704822454 tempest-VolumesSnapshotsTestJSON-704822454-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f" status: 404 len: 109 microversion: 2.1 time: 0.093677 Aug 04 02:17:02.627090 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:17:02 2022] GET /compute/v2.1/os-volumes/2a7d1173-3278-4174-9cca-0935cbf7b93f => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:17:02.965592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-942087950", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:03.193851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] validate_networks() for [('9802934c-f69c-40a4-8c5e-9fb52ddbb971', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:06.048116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:06.049568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:06.050188 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:06.050874 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:06.051435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:06.080128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:06.081025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:06.085441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:06.094221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:06.201438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:06.220994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for user 033f13b2943945d3abc4ff852b68d698 and project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:06.257244 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:06.267389 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:06.494875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f67952a4-14ce-4274-a4d2-8b7d762547be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.780181 Aug 04 02:17:06.497124 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 15/30] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:17:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:17:06.509752 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-215ce5a4-400f-4325-8df9-8c2dcbdc7dc1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:06.511553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-215ce5a4-400f-4325-8df9-8c2dcbdc7dc1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:07.691033 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-215ce5a4-400f-4325-8df9-8c2dcbdc7dc1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:07.759770 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-215ce5a4-400f-4325-8df9-8c2dcbdc7dc1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1221 microversion: 2.1 time: 1.253689 Aug 04 02:17:07.775677 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 16/31] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:06 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1221 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:08.370487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-754845043", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:08.538823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] validate_networks() for [('9802934c-f69c-40a4-8c5e-9fb52ddbb971', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:09.286282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2023616061", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "networks": [{"uuid": "ad96f9bb-a75d-449e-a125-0743ca8acc02"}]}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:09.690695 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] validate_networks() for [('ad96f9bb-a75d-449e-a125-0743ca8acc02', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:13.190264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:13.191392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:13.192438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:13.192984 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:13.193448 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:13.230431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:13.230895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:13.242705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:13.243549 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:13.345865 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:13.367112 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for user 033f13b2943945d3abc4ff852b68d698 and project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:13.437970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:13.446816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:13.657586 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2727daca-ddc4-4cd1-b99c-cb21a4e4d0c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.293293 Aug 04 02:17:13.666965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 16/32] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:17:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 5304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:17:14.336273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:14.338383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:14.339275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:14.339924 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:14.340560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:14.389226 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:14.389996 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:14.391372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:14.392184 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:14.467034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Getting quotas for project de98ffc315d4474c8b5d5370ba1fe97c. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:14.479662 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Getting quotas for user 44655d95949b489088dbe48eeb8f38f7 and project de98ffc315d4474c8b5d5370ba1fe97c. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:14.516130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:14.525125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:14.769031 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1439c1e8-4c1f-4375-96d6-c90157c1cad5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.192529 Aug 04 02:17:14.775989 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 17/33] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 6200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:17:14.788486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-03838e08-f835-4b75-892f-1f649d39a2ff tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: .version_select at 0x7ff494bbdf70>, body: {"keypair": {"name": "tempest-keypair-1956664267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz51zockEzC7j8V1FjnAJLA9wV86pOOKRfhLPYOigmIpIxn60uNr8JAyePyZD/LTYrhADQUTlXOaq5MDG9ttmBUrZH+J/SZxEEv1jLhbH/l349s7dgqhXJc4S9+gGXNHw=="}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:14.871978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-03838e08-f835-4b75-892f-1f649d39a2ff tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for project 11284ae13d2f4c5ba47517f672968623. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:14.896743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-03838e08-f835-4b75-892f-1f649d39a2ff tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for user df5d3de1afa945c3b0873050eca06c0c and project 11284ae13d2f4c5ba47517f672968623. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:15.025196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-03838e08-f835-4b75-892f-1f649d39a2ff tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.356688 Aug 04 02:17:15.042881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 17/34] 10.222.0.45 () {62 vars in 1200 bytes} [Thu Aug 4 02:17:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1375 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 02:17:15.078598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a4f84087-7821-4feb-afb2-e2384ee0dc52 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:15.081535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a4f84087-7821-4feb-afb2-e2384ee0dc52 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:15.472112 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a4f84087-7821-4feb-afb2-e2384ee0dc52 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:15.530026 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a4f84087-7821-4feb-afb2-e2384ee0dc52 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1221 microversion: 2.1 time: 0.478002 Aug 04 02:17:15.537011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 18/35] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:15 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1221 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:15.565392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9fb237cf-441c-4328-b2bb-702111ea62b7 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:15.566036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9fb237cf-441c-4328-b2bb-702111ea62b7 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:15.682052 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8467fb28-e050-4bb6-b8a3-28e2ee739ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: .version_select at 0x7ff4953cba60>, body: {"keypair": {"name": "tempest-keypair-265865914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALq+i4pQXR4yS80xsfbDpm3QCmb9bGFVWN2QdvQzorZvs+OnZL++6vX1C+/tXeg58KjTy5EXzfFE2Qa6YnxCrBgyvbGf3MUeLgQdDoM+w+/Ytqs+GAUwlXegrM7o3gSdA=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:15.791127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-8467fb28-e050-4bb6-b8a3-28e2ee739ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:15.800161 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-8467fb28-e050-4bb6-b8a3-28e2ee739ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:16.004019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8467fb28-e050-4bb6-b8a3-28e2ee739ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.224893 Aug 04 02:17:16.013990 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 18/36] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:17:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:16.510526 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9fb237cf-441c-4328-b2bb-702111ea62b7 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:16.534690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9fb237cf-441c-4328-b2bb-702111ea62b7 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1215 microversion: 2.1 time: 0.990957 Aug 04 02:17:16.536746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 19/37] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:15 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1215 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:16.559179 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:16.559806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:16.588083 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:16.588595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:16.615702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:16.618466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:17.567479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:17.568903 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:17.583805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:17.585780 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:17.586757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:17.588680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:18.021737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:18.096183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-66926de6-12e7-4e28-af94-7cc04c415f76 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1273 microversion: 2.1 time: 1.522664 Aug 04 02:17:18.102144 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:16 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1273 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:18.375693 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:18.411640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-834d9c47-11d1-484d-a297-b758efd7ac1d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1267 microversion: 2.1 time: 0.840138 Aug 04 02:17:18.414839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:17 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1267 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:19.122069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:19.122944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:19.135077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:19.139260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:19.141526 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:19.144252 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:19.511488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:19.530467 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e6d3120e-3224-49d2-960a-baf3da5b0ea4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1279 microversion: 2.1 time: 0.407750 Aug 04 02:17:19.532043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:19 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1279 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:19.549734 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:19.550546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:19.579350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:19.582147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:19.587639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:19.590382 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:19.669085 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-30751f6c-b813-45f3-9ab7-f9024c34703a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: .version_select at 0x7ff49430a700>, body: {"keypair": {"name": "tempest-keypair-170385646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx2nZBuJselUiMz14viMxzrhMv7kInSd6s8NnHBa726gcFD3SPc7rO2YxQhIWiYA/t6EEtpI4DyycNZuS0g+R3KNWQ9TgJziU0KcL/Mce4KKhWxOVwaa3BC22tObixX2Q=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:19.704289 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-30751f6c-b813-45f3-9ab7-f9024c34703a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:19.723672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-30751f6c-b813-45f3-9ab7-f9024c34703a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for user 26e73db77d93496883b66572d6bf35f2 and project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:19.748166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:19.759599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6af90713-5ba6-4243-9ef7-84dff2d13448 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1273 microversion: 2.1 time: 0.224889 Aug 04 02:17:19.774635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:19 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:19.799390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-30751f6c-b813-45f3-9ab7-f9024c34703a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.924158 Aug 04 02:17:19.800006 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:17:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:20.554251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:20.555982 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:20.571034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:20.573116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:20.576731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:20.577401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:20.783898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:20.785376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:20.797781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:20.808237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7f041075-29bc-43ba-a316-ae4d1ee50c55 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1279 microversion: 2.1 time: 0.260110 Aug 04 02:17:20.818771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:20.820294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:20.821407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:20.821677 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:20 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1279 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:20.826562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:20.988500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:21.011951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c592e6f1-012e-4724-9f7a-14f9187cd3ba tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1273 microversion: 2.1 time: 0.232245 Aug 04 02:17:21.018401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:20 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:21.833812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:21.834433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:21.860906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:21.861380 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:21.868091 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:21.873413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:22.043211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:22.044582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:22.069103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:22.070978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:22.077208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:22.077781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:22.450788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:22.467962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a3d8bb56-8270-4e82-ad06-a540f64e127b tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1273 microversion: 2.1 time: 0.427023 Aug 04 02:17:22.469165 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 22/45] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:22 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:22.487124 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:22.500059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5b913db3-b5e3-4682-ad00-c22544837044 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1279 microversion: 2.1 time: 0.672447 Aug 04 02:17:22.514426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 24/46] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:21 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1279 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:23.493857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:23.494538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:23.503253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:23.503705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:23.522540 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:23.523157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:23.523721 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:23.524187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:23.536540 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=4 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:23.539582 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:23.540313 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:23.542721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:23.543381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:24.134539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:24.146186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc851dd5-7eff-4ab2-a2cc-dd66170580f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1279 microversion: 2.1 time: 0.628744 Aug 04 02:17:24.160248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 25/47] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:23 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1279 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:24.379580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-086957f3-55b8-42e3-aaab-9a4998d9942e req-dd221d71-5171-4972-af43-857fcfed763a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a319988c-e250-4b92-a587-cc65e764dd56", "tag": "fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:24.412364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=7 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:24.422469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:24.425305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-086957f3-55b8-42e3-aaab-9a4998d9942e req-dd221d71-5171-4972-af43-857fcfed763a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:24.427622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-086957f3-55b8-42e3-aaab-9a4998d9942e req-dd221d71-5171-4972-af43-857fcfed763a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:24.457921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:24.481512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4757178c-2311-4a8d-b974-5ad1e6947d6f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1273 microversion: 2.1 time: 0.991754 Aug 04 02:17:24.482206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:23 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1273 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:24.494253 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-086957f3-55b8-42e3-aaab-9a4998d9942e req-dd221d71-5171-4972-af43-857fcfed763a service nova] Creating event network-changed:fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e for instance a319988c-e250-4b92-a587-cc65e764dd56 on hv-cinder-74014 Aug 04 02:17:24.496854 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-086957f3-55b8-42e3-aaab-9a4998d9942e req-dd221d71-5171-4972-af43-857fcfed763a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 02:17:24.507805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:24.507805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:24.507805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:24.507805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:24.534058 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.compute.rpcapi [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 02:17:24.535798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] Releasing lock "compute-rpcapi-router" {{(pid=118168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 02:17:24.590792 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fc828e81-d0a2-4d60-b9ca-629e98fe9f0c None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407314 Aug 04 02:17:24.592110 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 26/49] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:25.173876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:25.175307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:25.187436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:25.192014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:25.193221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:25.194279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:25.504381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:25.505185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:25.526069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:25.526543 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:25.534824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:25.536104 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:25.870907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:25.894817 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8235f554-ab0a-4567-b6f0-3b9e8f3b718c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1273 microversion: 2.1 time: 0.394952 Aug 04 02:17:25.895901 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 27/50] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:25 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:26.044748 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-44962976", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5813221-e639-425b-a3c4-33938890da3f"}], "security_groups": [{"name": "tempest-securitygroup--553452347"}], "key_name": "tempest-keypair-1956664267", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:26.320963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:26.335339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2631268d-bb3e-44aa-98c1-a88d59013a1a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 1.171356 Aug 04 02:17:26.336136 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 24/51] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:25 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:26.342815 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1274013485", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3fd5976-8837-4886-aaff-706d72d2761f"}], "security_groups": [{"name": "tempest-securitygroup--1471724797"}], "key_name": "tempest-keypair-265865914", "user_data": "}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:26.422566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] validate_networks() for [('a5813221-e639-425b-a3c4-33938890da3f', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:26.531829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=20 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:26.760129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] validate_networks() for [('c3fd5976-8837-4886-aaff-706d72d2761f', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:27.585161 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:27.586177 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:27.586863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:27.587528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:27.588191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:27.604639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:27.613948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:27.616261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:27.618102 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:27.691467 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for project 11284ae13d2f4c5ba47517f672968623. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:27.697951 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for user df5d3de1afa945c3b0873050eca06c0c and project 11284ae13d2f4c5ba47517f672968623. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:27.724181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:27.726753 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:27.836443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e1710744-75e0-4f9c-91a8-2e1c91684a22 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.800080 Aug 04 02:17:27.841838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 28/52] 10.222.0.45 () {62 vars in 1188 bytes} [Thu Aug 4 02:17:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 02:17:27.862929 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:27.863558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:27.890100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:27.891815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:27.893930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:27.898988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:28.630307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:28.643481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aab3c443-9e77-4835-ae37-b03bb5f21bb0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.791159 Aug 04 02:17:28.659388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 29/53] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:27 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:28.671835 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:28.679808 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:28.694582 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:28.695408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:28.696663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:28.698737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:28.842841 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:28.843403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:28.843736 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:28.844956 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:28.846107 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:28.907707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:28.918322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:28.923283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:28.927734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:29.039923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:29.084140 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:29.163704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:29.195894 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:29.397093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-51808cc5-0b67-4730-99c4-4ee005f48d28 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.059556 Aug 04 02:17:29.400001 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 25/54] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:17:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:17:29.418015 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-202034468", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3562015-01a8-442c-9260-a631d3a466e0"}], "security_groups": [{"name": "tempest-securitygroup--433781740"}], "key_name": "tempest-keypair-170385646", "user_data": "}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:29.533724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:29.543114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2a06a465-462a-48fa-b16c-ec94fe2f1cb8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.880908 Aug 04 02:17:29.543785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 30/55] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:28 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:29.561607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:29.562259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:29.611109 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:29.611551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:29.612340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:29.641269 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:30.157995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:30.186466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:30.191248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:30.198306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8454080f-c1b8-40f9-9aaf-bdeaf0e80658 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1276 microversion: 2.20 time: 0.653400 Aug 04 02:17:30.202650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 31/56] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:29 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1276 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:30.233961 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ab7b36fa-deb9-4386-bde8-e5c106d9ac7b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:30.235298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ab7b36fa-deb9-4386-bde8-e5c106d9ac7b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:30.939324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ab7b36fa-deb9-4386-bde8-e5c106d9ac7b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:30.947585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ab7b36fa-deb9-4386-bde8-e5c106d9ac7b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1241 microversion: 2.1 time: 0.739081 Aug 04 02:17:30.948162 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 32/57] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:30 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1241 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:30.978774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:30.979820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:31.003719 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:31.004689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:31.006182 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:31.007548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:31.027386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] validate_networks() for [('f3562015-01a8-442c-9260-a631d3a466e0', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:17:31.612629 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:31.624551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e947ac86-ef1a-4e7e-b22e-acb847c979da tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.654897 Aug 04 02:17:31.627746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 33/58] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:30 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:31.645809 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:31.646497 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:31.670224 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:31.670924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:31.672009 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:31.672599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.044226 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.051810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5977f9a7-09f6-4760-86d8-7f7a989e3ee5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.421954 Aug 04 02:17:32.054365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 34/59] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:31 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:32.059078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:32.059963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:32.072667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.072667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.072667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.072667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.144460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.153396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.154913 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.156132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1a1087c0-2c68-4a62-838b-3e4772f2fa00 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1338 microversion: 2.20 time: 0.100760 Aug 04 02:17:32.168915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 35/60] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:32 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:32.168915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-ef263616-0eaa-4868-9a96-abed4ea7c1ae req-2d9edd31-7cac-4617-ad6c-3c1ef76b6f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f941a4-8d6b-4c53-816d-e422f7e2a1f3", "tag": "c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:32.171555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ef263616-0eaa-4868-9a96-abed4ea7c1ae req-2d9edd31-7cac-4617-ad6c-3c1ef76b6f0d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.172005 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ef263616-0eaa-4868-9a96-abed4ea7c1ae req-2d9edd31-7cac-4617-ad6c-3c1ef76b6f0d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.183406 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:17:32.183899 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:17:32.184285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:17:32.184726 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:17:32.185139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:17:32.190925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-ef263616-0eaa-4868-9a96-abed4ea7c1ae req-2d9edd31-7cac-4617-ad6c-3c1ef76b6f0d service nova] Creating event network-changed:c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27 for instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 on hv-cinder-74014 Aug 04 02:17:32.195183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.195657 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.196470 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.196591 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-ef263616-0eaa-4868-9a96-abed4ea7c1ae req-2d9edd31-7cac-4617-ad6c-3c1ef76b6f0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038747 Aug 04 02:17:32.196947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.197208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 36/61] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:32.203711 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:32.205169 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:32.212917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.213238 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.214196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.214644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.215584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:17:32.219756 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for user 26e73db77d93496883b66572d6bf35f2 and project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:17:32.231915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:17:32.234131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:17:32.282655 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.291426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-86454793-dc2e-44a4-8029-d1e19c162dcf tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.888906 Aug 04 02:17:32.292670 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 26/62] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:17:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:17:32.295194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a7fc9d7f-c96c-4774-994a-8c0dede5e25e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1245 microversion: 2.1 time: 0.096643 Aug 04 02:17:32.296207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 37/63] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:32 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:32.320182 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d119da39-635a-4624-b202-6b1a00e20d58 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:32.321603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d119da39-635a-4624-b202-6b1a00e20d58 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:32.405164 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-ac17dd52-ce47-4bbd-a09a-becf0ef80a40 req-7e105b02-f2f2-4f7b-a7f3-9b13260f4574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf0bb22-f917-4e62-9421-ba1c47e9fe3d", "tag": "04b00635-c395-4a36-9c93-b89099d986b5"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:32.406872 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d119da39-635a-4624-b202-6b1a00e20d58 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.413301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:32.416703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d119da39-635a-4624-b202-6b1a00e20d58 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1236 microversion: 2.1 time: 0.106399 Aug 04 02:17:32.429429 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 38/64] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:32 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1236 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:32.443171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-ac17dd52-ce47-4bbd-a09a-becf0ef80a40 req-7e105b02-f2f2-4f7b-a7f3-9b13260f4574 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.444742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-ac17dd52-ce47-4bbd-a09a-becf0ef80a40 req-7e105b02-f2f2-4f7b-a7f3-9b13260f4574 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.493972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-ac17dd52-ce47-4bbd-a09a-becf0ef80a40 req-7e105b02-f2f2-4f7b-a7f3-9b13260f4574 service nova] Creating event network-changed:04b00635-c395-4a36-9c93-b89099d986b5 for instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d on hv-cinder-74014 Aug 04 02:17:32.494724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-ac17dd52-ce47-4bbd-a09a-becf0ef80a40 req-7e105b02-f2f2-4f7b-a7f3-9b13260f4574 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 02:17:32.496308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.496935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.497861 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.498458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.518407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.compute.rpcapi [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 02:17:32.519736 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 02:17:32.548238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c3c15f26-b2aa-4247-b256-081e67fcb3a4 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253303 Aug 04 02:17:32.555684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 27/65] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:32.655347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:32.657315 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:32.672165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.672987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.674388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:32.675322 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:32.702746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:32.893459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:32.902756 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c87ad871-fcf3-4436-bab5-255257b3268d tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.258852 Aug 04 02:17:32.903355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 39/66] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:32 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:33.073526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:33.074230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:33.081061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.081779 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.082550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.082991 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.179178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:33.179840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:33.185896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.186350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.187129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.187574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.217489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.225277 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7b7bd108-d7af-4b1e-8b92-19cccecc5e8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.156491 Aug 04 02:17:33.225962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 28/67] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:33 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:33.248666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.256558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.258669 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.259770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4318db7f-b497-4e95-9edc-e111cb842a55 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1338 microversion: 2.20 time: 0.084403 Aug 04 02:17:33.260340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 40/68] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:33 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1338 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:33.317338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:33.317890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:33.324527 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.325012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.325784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.326225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.385403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.392784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-08830489-6a32-4db9-9f3e-7d7f0a9d9726 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1245 microversion: 2.1 time: 0.079208 Aug 04 02:17:33.393356 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 29/69] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:33 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:33.438790 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:33.439403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:33.446083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.446529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.447291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.447725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.512344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:33.519730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bdf181b0-3b22-4cf2-885f-b7a7f349ca70 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1240 microversion: 2.1 time: 0.084801 Aug 04 02:17:33.520300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 41/70] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:33 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:33.923424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:33.924047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:33.930913 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.931369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:33.932428 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:33.932915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.096827 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.106415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f6d5ff23-8e3d-437e-b9fa-f38c9d00b0e9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.186681 Aug 04 02:17:34.107002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 30/71] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:33 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:34.248120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:34.248893 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:34.255724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.256184 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.257232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.266498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.281447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:34.282056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:34.290933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.291377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.292156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.292613 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.456801 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.468478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.470938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.473253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b65548f9-e852-4416-a5b5-157b3e834e39 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1338 microversion: 2.20 time: 0.195666 Aug 04 02:17:34.483637 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 31/72] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:34 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:34.491624 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:34.492559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:34.500128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.500578 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.501581 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.502022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.537016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.545139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3d7bb542-0d0f-49f1-b8e6-b29160bdd10c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.302490 Aug 04 02:17:34.546390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 42/73] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:34 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:34.551321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:34.552014 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:34.564026 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.564928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.565723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:34.566163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:34.579221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.596518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d640e614-bf76-46d4-91f5-0c6d5d21c651 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1293 microversion: 2.1 time: 0.111472 Aug 04 02:17:34.598595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 32/74] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:34 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:34.660274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:34.667481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e155a996-3d8e-4470-9794-e0a05dd68cc0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1288 microversion: 2.1 time: 0.119888 Aug 04 02:17:34.676824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 43/75] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:34 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:35.129251 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:35.130288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:35.139643 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.140092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.140891 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.141328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.305634 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.313431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-57fddf58-19a2-4657-80ea-84a71ce477c0 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.189942 Aug 04 02:17:35.313883 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 33/76] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:35 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:35.502352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:35.503634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:35.522167 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.522883 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.525451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.526601 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.566397 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:35.567007 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:35.581678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.582147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.583032 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.583474 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.829240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.831395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.842875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.843723 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e2cd7001-b906-46ec-b9d9-6524f1e8a10d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.280180 Aug 04 02:17:35.844584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 34/77] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:35 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:35.857427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.857427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-391b3f2e-42ce-43d9-a4eb-3334e610c4c9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.354786 Aug 04 02:17:35.857427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 44/78] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:35 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:35.857427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:35.857832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:35.864329 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:35.865086 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:35.868290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.868775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.869844 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.870285 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.880688 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.881164 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.882094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:35.882636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:35.946891 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:35.982027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0b592edc-29a9-45b9-a9b4-3cd3ad512ae4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1293 microversion: 2.1 time: 0.133095 Aug 04 02:17:35.982954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 45/79] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:35 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:36.011133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:36.021385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e62639cd-cc36-4c50-83c0-37f1e5e1eba6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1288 microversion: 2.1 time: 0.161724 Aug 04 02:17:36.022309 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 35/80] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:35 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1288 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:36.262310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-21a04316-6ef4-4e12-ba46-8c98b73861a1 req-0616b671-43b9-4dfa-83aa-9be63dd37160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:36.271981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-21a04316-6ef4-4e12-ba46-8c98b73861a1 req-0616b671-43b9-4dfa-83aa-9be63dd37160 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.272838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-21a04316-6ef4-4e12-ba46-8c98b73861a1 req-0616b671-43b9-4dfa-83aa-9be63dd37160 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.284781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-21a04316-6ef4-4e12-ba46-8c98b73861a1 req-0616b671-43b9-4dfa-83aa-9be63dd37160 service nova] Creating event network-changed:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:17:36.290947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-21a04316-6ef4-4e12-ba46-8c98b73861a1 req-0616b671-43b9-4dfa-83aa-9be63dd37160 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034002 Aug 04 02:17:36.291985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 46/81] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:36.334681 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:36.335292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:36.341929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.342376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.343204 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.343646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.496382 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:36.507080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9f5210bd-c530-4527-bea1-7de7c2899f1c tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.176414 Aug 04 02:17:36.507611 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 36/82] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:36 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:36.868834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:36.869470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:36.870258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:36.871287 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:36.875786 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.876229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.877022 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.877456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.879423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.879884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:36.880712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:36.881153 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.068643 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.073447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.076866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:37.077525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9f86dd32-c40b-4b3e-9ca4-5f2dc7aee289 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.212965 Aug 04 02:17:37.078194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 47/83] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:36 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:37.083186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:37.083871 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:37.085749 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.087345 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.088746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-81d56b18-8697-4ac7-bf55-2705b6da120c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.222606 Aug 04 02:17:37.089443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 37/84] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:36 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:37.089831 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.090280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.091038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.091546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.095018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:37.095740 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:37.101849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.102410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.103284 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.103803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.162241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.169680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-24ddce7f-5183-4801-867b-57fd7fde0375 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1293 microversion: 2.1 time: 0.090441 Aug 04 02:17:37.170247 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 48/85] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:37 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:37.181852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.189359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cbbe4370-5dc4-4318-9fe9-6084efaf5ceb tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1288 microversion: 2.1 time: 0.098181 Aug 04 02:17:37.189918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 38/86] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:37 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:37.530273 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:37.530883 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:37.537410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.537868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.538637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:37.539610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:37.645137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=4 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:37.667368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:37.674846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c4e12f9c-4ea9-4e84-bca6-06f95a48c326 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.148771 Aug 04 02:17:37.675351 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 49/87] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:37 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:38.098217 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:38.098744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:38.105325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.105783 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.106543 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.106985 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.110627 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:38.111361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:38.117427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.117909 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.118665 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.119092 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.304522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.306695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.312366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2bb2778d-75fb-4428-8a06-3564a5c8573b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.218025 Aug 04 02:17:38.313010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 39/88] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:38 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:38.316185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.317532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:38.318171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:38.318342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.319712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-895971a6-3a8e-451b-aaf2-75ba9dffd91a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.212894 Aug 04 02:17:38.329719 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.330500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.331429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.332253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.347398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 50/89] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:38 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:38.357554 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:38.361278 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:38.370320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.371144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.372216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.373544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.706085 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.715476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2dd41fba-47e4-4d00-977d-c14b6d3b703c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1293 microversion: 2.1 time: 0.401352 Aug 04 02:17:38.720970 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 40/90] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:38 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:38.725834 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:38.727052 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:38.744120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.744584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.745426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:38.745901 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:38.802306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:38.811141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cd56170c-a933-4053-9d57-d739534a99fd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1288 microversion: 2.1 time: 0.462468 Aug 04 02:17:38.818472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 51/91] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:38 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1288 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:39.250811 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.259601 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-070f9301-0514-49b6-b318-87a9a4908d9a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.537478 Aug 04 02:17:39.260513 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 41/92] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:38 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:39.338227 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:39.338844 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:39.344800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:39.345855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:39.352419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.356451 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.357372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.357860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.358751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.358983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.359495 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.359787 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.636687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.639064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.645807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4123b114-39bf-4461-9f64-d7a6bba3d57c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.312137 Aug 04 02:17:39.658900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.660189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 52/93] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:39 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:39.662393 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.663668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-978fb2f3-3c05-477a-89e0-f7092c9566ce tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.324108 Aug 04 02:17:39.664782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 42/94] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:39 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:39.739938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:39.740687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:39.747818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.748345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.749237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.749751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.813783 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.821318 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1f94f346-a98a-4c0a-9a63-40cd8a97d206 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1299 microversion: 2.1 time: 0.087803 Aug 04 02:17:39.821881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 53/95] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:39 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:39.839279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:39.839895 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:39.845938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.846420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.847261 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:39.847693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:39.912342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:39.921065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3113b1ba-4941-4755-8a68-86b472bded52 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1294 microversion: 2.1 time: 0.085574 Aug 04 02:17:39.921715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 43/96] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:39 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:40.280815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:40.282321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:40.290071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.292247 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:40.293584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.294142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:40.668335 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:40.669110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:40.670146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:40.678675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.681663 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:40.681793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-188ceb05-9e1c-4c08-ad66-303a45609305 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.404902 Aug 04 02:17:40.694755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 54/97] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:40 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:40.694982 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.694982 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:40.695667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:40.695667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:40.706069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.710644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:40.711925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:40.712541 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.343871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.352320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3906d8c6-bc9b-4449-b17b-a753b2c5aa15 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.687964 Aug 04 02:17:41.354454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 44/98] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:40 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:41.362800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.391535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.393127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.394365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fea0495b-fa28-4390-8fbb-275de5497616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.710837 Aug 04 02:17:41.394965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 55/99] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:40 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:41.401423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:41.402435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:41.422799 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.423276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.424063 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.424500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.482323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-5dd5f687-ab4b-443d-bf22-ab74a9c101e4 req-77e39951-9bb3-412a-9336-9489a924a958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a319988c-e250-4b92-a587-cc65e764dd56", "name": "network-vif-plugged", "status": "completed", "tag": "fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:41.506765 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-5dd5f687-ab4b-443d-bf22-ab74a9c101e4 req-77e39951-9bb3-412a-9336-9489a924a958 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.508314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-5dd5f687-ab4b-443d-bf22-ab74a9c101e4 req-77e39951-9bb3-412a-9336-9489a924a958 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.532796 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-5dd5f687-ab4b-443d-bf22-ab74a9c101e4 req-77e39951-9bb3-412a-9336-9489a924a958 service nova] Creating event network-vif-plugged:fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e for instance a319988c-e250-4b92-a587-cc65e764dd56 on hv-cinder-74014 Aug 04 02:17:41.549417 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-5dd5f687-ab4b-443d-bf22-ab74a9c101e4 req-77e39951-9bb3-412a-9336-9489a924a958 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184060 Aug 04 02:17:41.553559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 45/100] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:41.559758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:41.561497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:41.568337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.568804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.574429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.575277 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.618950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.626052 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:41.635692 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d59ca4cd-8849-4858-bd98-0fdd6566c56c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1299 microversion: 2.1 time: 0.238091 Aug 04 02:17:41.638645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 56/101] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:41 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:41.688384 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:41.697397 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-603c8f6c-908c-4b36-ab17-565a93e36ccc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1294 microversion: 2.1 time: 0.141711 Aug 04 02:17:41.698178 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 46/102] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:41 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:41.709149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:41.709834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:41.717120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.717581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.718414 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:41.718856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:41.996707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:42.004406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-67115581-8a61-48e8-a924-015dc73eabb3 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.305632 Aug 04 02:17:42.005214 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 57/103] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:41 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:42.371273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=28 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:42.375269 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:42.375889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:42.384207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.384774 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.385690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.386060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.420390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:42.421312 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:42.424508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=10 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:42.429027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.429724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.430522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.431149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.513345 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:42.584257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:42.592906 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f07bd84b-00b1-4b78-94a1-8ba2ffa04a30 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.222430 Aug 04 02:17:42.593744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 47/104] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:42 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:42.619207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:42.627863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:42.629366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:42.630892 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e323f877-47c3-4922-a2ee-27f6a999d056 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.214094 Aug 04 02:17:42.631012 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 58/105] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:42 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:42.658554 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:42.659429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:42.666475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.666928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.667699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.668138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.720286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:42.720286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:42.731281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.731876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:42.732770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:42.733181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.030045 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:43.042706 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-54132990-8ff9-40cf-a2c9-20b9720f95a8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.385861 Aug 04 02:17:43.052656 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 48/106] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:42 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:43.053247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:43.058350 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:43.074915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.076592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.077443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.079790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.245333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:43.259795 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d1773728-c465-4a52-85ea-490b3c38406c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.544423 Aug 04 02:17:43.261302 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 59/107] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:42 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:43.578386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:43.586775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-313d55ae-df7d-4b99-aa4a-5128e89f8cea tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.541516 Aug 04 02:17:43.587360 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 49/108] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:43 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:43.614598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:43.615199 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:43.621272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.621711 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.622470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.622896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.658145 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:43.659064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:43.666473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.666965 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:43.667725 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:43.668161 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.178584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.188861 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-20b7b4a0-1741-4e29-9658-9ab0b5d0183d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.577987 Aug 04 02:17:44.190091 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 60/109] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:43 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:44.210449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:44.211092 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:44.217649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.218261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.219109 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.219616 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.237548 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.247365 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.248891 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.250198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a8eaabe2-2a5d-415b-9136-58de5b04bc05 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.598785 Aug 04 02:17:44.269957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 50/110] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:43 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:44.286448 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:44.287980 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:44.295744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.296238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.297164 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.297595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.698037 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.710157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e88892d2-c563-4e83-9794-92c18a5047f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.503918 Aug 04 02:17:44.713409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 61/111] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:44 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:44.722277 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:44.725809 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:44.741747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.744004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.746099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.746556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.785973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:44.808274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-faba3c56-8f14-4a9b-9036-5a17d36021a2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.528407 Aug 04 02:17:44.809588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 51/112] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:44 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:44.827678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-8b1d97f0-2178-4150-b31a-d009dbd48908 req-0bdf8059-6bb2-4df7-8cd4-e773fbc955ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f941a4-8d6b-4c53-816d-e422f7e2a1f3", "name": "network-vif-plugged", "status": "completed", "tag": "c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:44.842296 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-8b1d97f0-2178-4150-b31a-d009dbd48908 req-0bdf8059-6bb2-4df7-8cd4-e773fbc955ea service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:44.842910 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-8b1d97f0-2178-4150-b31a-d009dbd48908 req-0bdf8059-6bb2-4df7-8cd4-e773fbc955ea service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:44.867218 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-8b1d97f0-2178-4150-b31a-d009dbd48908 req-0bdf8059-6bb2-4df7-8cd4-e773fbc955ea service nova] Creating event network-vif-plugged:c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27 for instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 on hv-cinder-74014 Aug 04 02:17:44.873979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-8b1d97f0-2178-4150-b31a-d009dbd48908 req-0bdf8059-6bb2-4df7-8cd4-e773fbc955ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062628 Aug 04 02:17:44.874943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 52/113] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:44.969144 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-39f52071-add1-417e-9316-f8865fbc6105 req-0bb946b2-e620-40bc-9723-ae315b792ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5204e1c-198d-4f48-82e4-b7235cdc9e68", "tag": "8bf46035-8e5d-4c05-8c39-1534e9c498af"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:44.996084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-39f52071-add1-417e-9316-f8865fbc6105 req-0bb946b2-e620-40bc-9723-ae315b792ef6 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.006040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-39f52071-add1-417e-9316-f8865fbc6105 req-0bb946b2-e620-40bc-9723-ae315b792ef6 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.049661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-39f52071-add1-417e-9316-f8865fbc6105 req-0bb946b2-e620-40bc-9723-ae315b792ef6 service nova] Creating event network-changed:8bf46035-8e5d-4c05-8c39-1534e9c498af for instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 on hv-cinder-74014 Aug 04 02:17:45.066566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-39f52071-add1-417e-9316-f8865fbc6105 req-0bb946b2-e620-40bc-9723-ae315b792ef6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105437 Aug 04 02:17:45.069437 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 53/114] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:17:45.213837 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:45.215002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:45.232316 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.232896 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.234248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.234796 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.406739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:45.415863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3aa21177-ac68-4496-9e3b-56997d34af71 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.700971 Aug 04 02:17:45.430709 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 62/115] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:44 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:45.438007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:45.438803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:45.462195 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.463986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.464982 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.469247 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.666416 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:45.674717 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e133f4b8-3cca-49fa-b0ba-dca054b51e8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.466544 Aug 04 02:17:45.675477 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 54/116] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:45 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:45.731830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:45.733250 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:45.740830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.741507 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.742623 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:45.743429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:45.995423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.016592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.020590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.024831 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ce105726-6479-42d9-b7c5-78ba0a41b616 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.589955 Aug 04 02:17:46.026409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 63/117] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:45 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:46.030933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.042385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-17027fbb-b9ec-4ccb-9c1f-e69eb01d1e10 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.313493 Aug 04 02:17:46.043280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 55/118] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:45 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:46.045775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:46.046871 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:46.054142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.055517 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.056847 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.058065 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.296832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.305197 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b4cac10e-ec70-457d-be14-06947d826e69 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.268820 Aug 04 02:17:46.308774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 64/119] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:46 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:46.441409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:46.442386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:46.458141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.458608 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.459489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.461816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.497945 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:46.695802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:46.696422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:46.710150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.714830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.716525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:46.717023 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.717740 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:46.724512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b1ee81d4-0acb-437d-99c2-dd0e7abfa279 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.291001 Aug 04 02:17:46.737297 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 56/120] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:46 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:46.895596 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:46.906857 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b8cdcac8-ef6c-411f-a90d-89bd606347ca tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1321 microversion: 2.1 time: 0.214634 Aug 04 02:17:46.908832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 65/121] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:46 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:47.051978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:47.053007 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:47.062077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.062702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.063935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.064964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.067364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:47.067987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:47.079831 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:47.082108 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.083843 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.092525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.092870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.360298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:47.370848 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:47.371089 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:47.373318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:47.374722 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-965a5558-db90-46f1-bb7b-c5e5af7e506e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.329188 Aug 04 02:17:47.376431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 57/122] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:47 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:47.384188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-df0a34d7-a659-43c3-a608-56dc7b652387 req-5b348567-bc03-4a10-8027-baae77e7d1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36731bfb-cc25-4fcc-8c46-b4abfad95a16", "tag": "8127a1da-4bc3-4dc9-96d0-34260651ad7e"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:47.395927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-df0a34d7-a659-43c3-a608-56dc7b652387 req-5b348567-bc03-4a10-8027-baae77e7d1d3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.396551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-384e0325-9148-4063-ad01-24c55255ef37 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.333014 Aug 04 02:17:47.396925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-df0a34d7-a659-43c3-a608-56dc7b652387 req-5b348567-bc03-4a10-8027-baae77e7d1d3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.400781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 66/123] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:47 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:47.405658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:47.406558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:47.413477 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-df0a34d7-a659-43c3-a608-56dc7b652387 req-5b348567-bc03-4a10-8027-baae77e7d1d3 service nova] Creating event network-changed:8127a1da-4bc3-4dc9-96d0-34260651ad7e for instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 on hv-cinder-74014 Aug 04 02:17:47.416540 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.417240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.420478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-df0a34d7-a659-43c3-a608-56dc7b652387 req-5b348567-bc03-4a10-8027-baae77e7d1d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041566 Aug 04 02:17:47.422372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.425033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.425802 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 58/124] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:47.431861 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-0f40f1ae-3951-4adc-9ad3-30ca6ee07488 req-781cf10e-5457-438e-890a-6f6588ddf1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "name": "network-vif-plugged", "status": "completed", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:47.448042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0f40f1ae-3951-4adc-9ad3-30ca6ee07488 req-781cf10e-5457-438e-890a-6f6588ddf1a3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.449421 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0f40f1ae-3951-4adc-9ad3-30ca6ee07488 req-781cf10e-5457-438e-890a-6f6588ddf1a3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.462984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-0f40f1ae-3951-4adc-9ad3-30ca6ee07488 req-781cf10e-5457-438e-890a-6f6588ddf1a3 service nova] Creating event network-vif-plugged:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:17:47.469072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-0f40f1ae-3951-4adc-9ad3-30ca6ee07488 req-781cf10e-5457-438e-890a-6f6588ddf1a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041771 Aug 04 02:17:47.470707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 59/125] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:47.599899 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:47.610942 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4c21e725-8a45-49f8-a0d9-973a42353b56 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.212283 Aug 04 02:17:47.617810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 67/126] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:47 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:47.749062 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:47.749769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:47.758541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.759143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.759939 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.760375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.929187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:47.929870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:47.940293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.940759 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:47.941609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:47.942039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.015468 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.032411 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cea1d570-bae5-4758-8a57-773649f93068 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.288024 Aug 04 02:17:48.033869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 60/127] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:47 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:48.140306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.148827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6360c573-2b18-41d9-944b-b04ccb1f108f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1516 microversion: 2.1 time: 0.222687 Aug 04 02:17:48.149644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 68/128] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:47 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:48.171396 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:48.173976 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:48.180882 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.181714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.182496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.183092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.253581 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'flavor' on Instance uuid 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:17:48.391582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c4665f44-a39a-4fb5-9134-e437778469fa tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3/action" status: 200 len: 32 microversion: 2.1 time: 0.224407 Aug 04 02:17:48.392393 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 61/129] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:17:48 2022] POST /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:17:48.402171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:48.402788 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:48.404674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:48.405364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:48.411683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.412129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.412251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.412929 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.413656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.415068 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.416197 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.416783 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.694554 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.705075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.707216 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.708353 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fda9bf8b-f108-4506-af60-f65430144354 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.308456 Aug 04 02:17:48.723184 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 62/130] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:48 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:17:48.723508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:48.723604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:48.723604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:48.726954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6b1f2c1c-9d9d-4885-9b16-1cbb1f508c99 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.328472 Aug 04 02:17:48.727744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 69/131] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:48 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:48.732868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:48.734597 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:48.746489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.746944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.747730 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.748648 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.755940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.756407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:48.757221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:48.758194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.048158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:49.060212 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-940a4b57-6b7f-433f-9847-b894b6f39430 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.346506 Aug 04 02:17:49.063708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 63/132] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:48 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:49.081464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:49.083473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:49.091738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.102480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.113617 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.114268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.713051 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:49.722013 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f877fc9f-1d7f-4e4a-8ae8-4446d15f4d14 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.993228 Aug 04 02:17:49.727753 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 70/133] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:48 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:49.732833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-b72deb42-0555-4f2f-bb26-f53b634d689e req-53abd832-0c2e-449c-bb83-236655650e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf0bb22-f917-4e62-9421-ba1c47e9fe3d", "name": "network-vif-plugged", "status": "completed", "tag": "04b00635-c395-4a36-9c93-b89099d986b5"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:49.762410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b72deb42-0555-4f2f-bb26-f53b634d689e req-53abd832-0c2e-449c-bb83-236655650e6b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.762859 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b72deb42-0555-4f2f-bb26-f53b634d689e req-53abd832-0c2e-449c-bb83-236655650e6b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.783887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-b72deb42-0555-4f2f-bb26-f53b634d689e req-53abd832-0c2e-449c-bb83-236655650e6b service nova] Creating event network-vif-plugged:04b00635-c395-4a36-9c93-b89099d986b5 for instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d on hv-cinder-74014 Aug 04 02:17:49.802914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-b72deb42-0555-4f2f-bb26-f53b634d689e req-53abd832-0c2e-449c-bb83-236655650e6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073651 Aug 04 02:17:49.803499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 71/134] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:49.850334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:49.850589 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:49.874132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.876066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.878754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.880820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.884914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:49.895514 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-34932b2e-6751-4dfa-b91b-520728bfd2a6 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.830514 Aug 04 02:17:49.896109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 64/135] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:49 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:49.917251 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:49.918139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:49.942509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.943358 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:49.946401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:49.947263 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.270997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:50.280016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:50.281495 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:50.282795 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-85051393-4b5f-4602-9dcf-93e932886d76 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1405 microversion: 2.20 time: 0.459273 Aug 04 02:17:50.283403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 72/136] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:49 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:50.288114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:50.289451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:50.296274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.296949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.297904 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.298850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.427003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:50.455643 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b16bf0bd-8e1e-4309-99e3-69e58ae90102 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.545617 Aug 04 02:17:50.457719 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 65/137] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:49 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:50.542120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:50.549992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0a874c05-1043-4f14-9ea2-7694ad32e13d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.265398 Aug 04 02:17:50.550598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 73/138] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:50 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:50.743604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:50.744114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:50.753961 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.757401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.759563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.760375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.936326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:50.937606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:50.955967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.956878 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.959182 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:50.962427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:50.982209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:51.037487 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.049546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-88ba9aae-9c34-4428-890c-9452cc125b4d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.310311 Aug 04 02:17:51.082690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 66/139] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:50 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:51.262320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.271880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0d09bdd4-fcfc-4549-8f46-2426067a5608 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.353068 Aug 04 02:17:51.272469 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 74/140] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:50 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:51.310713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:51.311407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:51.319923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.320889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.322668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.323495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.481485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:51.482792 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:51.491527 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.492555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.493806 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.494623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.515147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.528331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.530820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.532698 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a7b29158-d4e4-4239-a443-6f569caae519 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1597 microversion: 2.20 time: 0.229522 Aug 04 02:17:51.533456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 67/141] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:17:51 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1597 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:17:51.561761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:51.562347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:51.574476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.578486 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.579350 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.579800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.698973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f1566602-86ef-44ff-b4f3-0293372e7143 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143105 Aug 04 02:17:51.700469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 68/142] 10.222.0.45 () {60 vars in 1316 bytes} [Thu Aug 4 02:17:51 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 02:17:51.706721 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:51.707595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:51.717254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.717720 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.719500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.719951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.890396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.905845 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a7525d4b-1cf8-4c45-b91f-42d31ad59370 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.431177 Aug 04 02:17:51.906378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 75/143] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:51 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:51.911443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-a3dfa8b6-639f-4a08-b9c8-2a098880914f req-78a2a8a0-136b-4e42-b30c-11e05b1a4ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36731bfb-cc25-4fcc-8c46-b4abfad95a16", "name": "network-vif-plugged", "status": "completed", "tag": "8127a1da-4bc3-4dc9-96d0-34260651ad7e"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:51.925034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-a3dfa8b6-639f-4a08-b9c8-2a098880914f req-78a2a8a0-136b-4e42-b30c-11e05b1a4ed7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:51.926774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-a3dfa8b6-639f-4a08-b9c8-2a098880914f req-78a2a8a0-136b-4e42-b30c-11e05b1a4ed7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:51.937120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:51.947918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8918700c-114f-4b97-9c96-0975324ae36b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.246306 Aug 04 02:17:51.948488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 69/144] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:51 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:51.955774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-a3dfa8b6-639f-4a08-b9c8-2a098880914f req-78a2a8a0-136b-4e42-b30c-11e05b1a4ed7 service nova] Creating event network-vif-plugged:8127a1da-4bc3-4dc9-96d0-34260651ad7e for instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 on hv-cinder-74014 Aug 04 02:17:51.961904 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-a3dfa8b6-639f-4a08-b9c8-2a098880914f req-78a2a8a0-136b-4e42-b30c-11e05b1a4ed7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053893 Aug 04 02:17:51.962496 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 76/145] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:52.072324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:52.073076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:52.081449 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.082501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.083579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.084227 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.250439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:52.260160 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1aadb8c7-4aa8-421f-b0fb-abbd9ef2dccd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.192508 Aug 04 02:17:52.264536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 70/146] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:52 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:52.298337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:52.299332 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:52.306789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.307347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.309577 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.310438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.512987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:52.542096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d493364d-1b26-42a0-a927-14fa7de0fd0a tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1315 microversion: 2.1 time: 0.245608 Aug 04 02:17:52.542860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 77/147] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:52 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:52.927053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:52.927682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:52.936022 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.936771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.937710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.938301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.971126 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:52.971744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:52.984225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.984940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:52.985882 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:52.987985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.192423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:53.206483 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2e6e6671-ba18-4c3b-b849-d9706fb21b90 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.282875 Aug 04 02:17:53.211432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 71/148] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:52 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:53.222305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:53.230128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f9de46a7-c404-4837-a0bc-9f75d64208ed tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.262994 Aug 04 02:17:53.230671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:52 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:53.285838 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:53.286459 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:53.295428 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:53.295973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.299916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:53.300418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.567310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:53.567953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:53.576260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:53.580247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:53.587570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:53.588110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b0d14942-3319-4605-af23-29b499ddedb3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1361 microversion: 2.1 time: 0.305970 Aug 04 02:17:53.588930 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 72/150] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:53 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:53.591452 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.592393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:53.593071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.719494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-cd0ca6c0-d140-4c6d-93a2-bdee61b09c39 req-e257c848-d96b-4b93-822d-988e6535bde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:53.733155 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-cd0ca6c0-d140-4c6d-93a2-bdee61b09c39 req-e257c848-d96b-4b93-822d-988e6535bde1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:53.733571 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-cd0ca6c0-d140-4c6d-93a2-bdee61b09c39 req-e257c848-d96b-4b93-822d-988e6535bde1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:53.759235 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-cd0ca6c0-d140-4c6d-93a2-bdee61b09c39 req-e257c848-d96b-4b93-822d-988e6535bde1 service nova] Creating event network-changed:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:17:53.765431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-cd0ca6c0-d140-4c6d-93a2-bdee61b09c39 req-e257c848-d96b-4b93-822d-988e6535bde1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050326 Aug 04 02:17:53.769648 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 73/151] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:17:53.934816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:53.944231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-77afb502-c424-4b42-aaac-29288d73f885 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1502 microversion: 2.1 time: 0.383449 Aug 04 02:17:53.945783 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 79/152] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:53 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:53.982463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-636ccff6-8702-41d5-8098-ce2c90605cc1 req-8c854421-da73-4806-8fa7-1d52f8a4e844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5204e1c-198d-4f48-82e4-b7235cdc9e68", "name": "network-vif-plugged", "status": "completed", "tag": "8bf46035-8e5d-4c05-8c39-1534e9c498af"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:54.033865 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-636ccff6-8702-41d5-8098-ce2c90605cc1 req-8c854421-da73-4806-8fa7-1d52f8a4e844 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.038030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-636ccff6-8702-41d5-8098-ce2c90605cc1 req-8c854421-da73-4806-8fa7-1d52f8a4e844 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.073561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-636ccff6-8702-41d5-8098-ce2c90605cc1 req-8c854421-da73-4806-8fa7-1d52f8a4e844 service nova] Creating event network-vif-plugged:8bf46035-8e5d-4c05-8c39-1534e9c498af for instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 on hv-cinder-74014 Aug 04 02:17:54.089301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-636ccff6-8702-41d5-8098-ce2c90605cc1 req-8c854421-da73-4806-8fa7-1d52f8a4e844 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109185 Aug 04 02:17:54.097314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 74/153] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:54.234559 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:54.236574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:54.263258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:54.264317 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:54.271144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.272420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.275094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.277120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.279305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.279986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.283604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.288158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.714966 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:54.728300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-36bb5688-9bc3-4c05-91f5-bf8b77c07398 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.500772 Aug 04 02:17:54.731592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 80/154] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:54 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:54.739717 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:54.742877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:54.762689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.763465 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.765232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:54.767393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:54.827642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:54.842055 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fb78c8ab-ba4a-4c24-a370-4e69db28e2e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.589907 Aug 04 02:17:54.842653 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 75/155] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:54 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:55.157934 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:55.179188 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d01b8cc1-58c9-496f-a4b6-8c2ae6e19e9c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1548 microversion: 2.1 time: 0.446177 Aug 04 02:17:55.180362 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 81/156] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:54 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1548 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:55.202771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:55.204060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:55.228976 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.231844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:55.233512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.234930 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:55.377763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6ce6a693-71c2-4206-8e33-a6c55bd56930 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179869 Aug 04 02:17:55.378546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 76/157] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:17:55 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:55.741234 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44074a3e-43fe-4229-ad73-89e67cb69586"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:55.744436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:55.751922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.752366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:55.752936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:55.753216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.753644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:55.753758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:55.756018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:55.769473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.770359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:55.772427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:55.773589 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:56.376306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-023b839b-23ed-4e35-9b05-ab201ff2150f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "POST /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.638871 Aug 04 02:17:56.384336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 82/158] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:17:55 2022] POST /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:17:56.391836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:56.393274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:56.402991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:56.403681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:56.405038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:56.405630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:56.579170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:56.589915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5b481dd5-33fd-47e6-b816-770113e92bc3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.843249 Aug 04 02:17:56.591530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 77/159] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:55 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:56.770434 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:56.784586 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-14e0d398-f664-4f22-a4c0-344129f88d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1367 microversion: 2.1 time: 0.398051 Aug 04 02:17:56.793198 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 83/160] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:56 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:57.613872 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:57.615487 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:57.629094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:57.631505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:57.634577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:57.635170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:57.806666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:57.807288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:57.813826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:57.814275 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:57.815051 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:57.815670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:57.865023 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:57.873205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-77b79fbb-aa7a-4ea5-91c6-a457b86b7105 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.264920 Aug 04 02:17:57.873785 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 78/161] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:57 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:17:58.207576 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-535368e2-fab5-48bf-ac97-f44943983fdd req-0920e7bd-b13a-4805-8774-ab053d5e8d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36731bfb-cc25-4fcc-8c46-b4abfad95a16", "tag": "8127a1da-4bc3-4dc9-96d0-34260651ad7e"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:17:58.218278 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:58.227803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8c57adc7-00cb-44f9-93a2-e8f5f42cd041 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1558 microversion: 2.1 time: 0.425374 Aug 04 02:17:58.228704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-535368e2-fab5-48bf-ac97-f44943983fdd req-0920e7bd-b13a-4805-8774-ab053d5e8d4b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:58.229322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-535368e2-fab5-48bf-ac97-f44943983fdd req-0920e7bd-b13a-4805-8774-ab053d5e8d4b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:58.230593 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 84/162] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:57 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1558 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:58.245562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-535368e2-fab5-48bf-ac97-f44943983fdd req-0920e7bd-b13a-4805-8774-ab053d5e8d4b service nova] Creating event network-changed:8127a1da-4bc3-4dc9-96d0-34260651ad7e for instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 on hv-cinder-74014 Aug 04 02:17:58.251144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:58.251320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-535368e2-fab5-48bf-ac97-f44943983fdd req-0920e7bd-b13a-4805-8774-ab053d5e8d4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048399 Aug 04 02:17:58.251957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 79/163] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:17:58.252376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:58.259297 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:58.259995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:58.260816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:58.261412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:58.347633 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-eada749f-1809-4cfe-9995-5d5ea979762e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100059 Aug 04 02:17:58.353312 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 85/164] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:17:58 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:17:58.894879 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:17:58.895432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:17:58.904566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:58.905055 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:58.906634 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:17:58.907260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:17:59.322578 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:17:59.375754 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1725fec5-693a-41e3-ae14-9170b51539cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.478088 Aug 04 02:17:59.377592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:17:58 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:00.192596 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-32fbfe12-8aeb-43a5-84e6-7b341725a770 req-a2f37e15-5568-4440-93a3-ca86f89c5620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5204e1c-198d-4f48-82e4-b7235cdc9e68", "tag": "8bf46035-8e5d-4c05-8c39-1534e9c498af"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:00.210076 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-32fbfe12-8aeb-43a5-84e6-7b341725a770 req-a2f37e15-5568-4440-93a3-ca86f89c5620 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:00.211244 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-32fbfe12-8aeb-43a5-84e6-7b341725a770 req-a2f37e15-5568-4440-93a3-ca86f89c5620 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:00.229960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-32fbfe12-8aeb-43a5-84e6-7b341725a770 req-a2f37e15-5568-4440-93a3-ca86f89c5620 service nova] Creating event network-changed:8bf46035-8e5d-4c05-8c39-1534e9c498af for instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 on hv-cinder-74014 Aug 04 02:18:00.236868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-32fbfe12-8aeb-43a5-84e6-7b341725a770 req-a2f37e15-5568-4440-93a3-ca86f89c5620 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048697 Aug 04 02:18:00.238445 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 86/166] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:18:00.400475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:00.402572 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:00.410494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:00.411164 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:00.412167 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:00.412842 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:00.854998 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:00.868444 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4c2913ec-aae5-438f-8770-746f4837bcc6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.473564 Aug 04 02:18:00.871508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 81/167] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:00 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:01.890997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:01.891778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:01.901496 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:01.902315 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:01.903399 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:01.904046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:02.112552 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:02.129446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-01c211dc-c1f0-428e-8784-6612eb6768ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.242647 Aug 04 02:18:02.130644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 87/168] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:01 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:03.152498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:03.154235 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:03.165668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:03.166510 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:03.167489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:03.168748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:03.380284 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:03.389188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-92f26082-74ad-404b-ad77-7a6c3fdd00ce tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.241553 Aug 04 02:18:03.390075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 82/169] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:03 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:04.411730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:04.417634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:04.425703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:04.426153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:04.426925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:04.429274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:04.736082 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:04.745873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc6ff768-9a3c-46b0-8724-0efc54a1d891 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.339722 Aug 04 02:18:04.747909 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 88/170] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:04 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:05.768157 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:05.769466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:05.795821 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:05.796282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:05.806441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:05.807187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:06.015754 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:06.027084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-803949a4-d1e9-4f88-abdc-5e07bb49f9e2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.262795 Aug 04 02:18:06.028030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 83/171] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:05 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.049203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:07.050639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:07.060464 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.061257 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:07.062281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.062928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:07.247429 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:07.256189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b198dd0e-a89d-41f9-9180-2ead00320326 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.211311 Aug 04 02:18:07.257185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 89/172] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:07 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.768505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:07.769069 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:07.775768 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.776213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:07.777030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.777611 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:07.815876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:18:07.953492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c54b4ecc-9ad6-4314-8ba1-b0c0c25f21d2 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 204 len: 0 microversion: 2.1 time: 0.188031 Aug 04 02:18:07.954665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 84/173] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:18:07 2022] DELETE /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:07.963402 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:07.964027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:07.980307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.980875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:07.981704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:07.982386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:08.263821 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:08.282454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:08.283280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:08.295727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b1ecf852-4421-48a0-81b5-655e7e74c08e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1554 microversion: 2.1 time: 0.336395 Aug 04 02:18:08.298105 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 90/174] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:07 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1554 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:08.299101 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:08.299546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:08.300747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:08.301264 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:08.465743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:08.473944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ff1f41e1-b88c-4a9e-af03-6d3139a86fe6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.198571 Aug 04 02:18:08.474527 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 85/175] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:08 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:09.319893 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:09.321166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:09.329763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:09.330413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:09.331407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:09.331659 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:09.338095 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:09.483912 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:09.494043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7051b8f3-9365-41bb-8632-1694c6a446f1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1554 microversion: 2.1 time: 0.176691 Aug 04 02:18:09.494043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 91/176] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:09 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:09.499298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:09.500476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:09.508843 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:09.509294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:09.510076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:09.510512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:09.712510 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:09.720761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b6c8d624-32cf-440b-b04d-bd1d2e41282b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.229350 Aug 04 02:18:09.730522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 86/177] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:09 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:10.515881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:10.517052 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:10.524490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:10.525167 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:10.526128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:10.526898 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:10.685625 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:10.694599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bc41e2e3-2e3b-46fc-a8a1-907faf740716 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1554 microversion: 2.1 time: 0.184265 Aug 04 02:18:10.695858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 92/178] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:10 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:10.743034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:10.743788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:10.751012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:10.751707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:10.752667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:10.753120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:10.916434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:10.927106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3361b9bc-df59-46d2-a090-aa3d0e381812 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.188701 Aug 04 02:18:10.928436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 87/179] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:10 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:11.716491 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:11.717146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:11.733667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:11.735222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:11.736050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:11.736498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:11.950582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:11.951211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:11.979820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:11.980284 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:11.985689 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:11.986156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:12.061088 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:12.080669 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-35c64435-1333-46c3-b536-603cb429e2c1 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1554 microversion: 2.1 time: 0.367833 Aug 04 02:18:12.089008 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 93/180] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:11 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1554 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:12.328939 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:12.351508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-14e4fdfc-6a18-4dfd-941f-da4ba11322f4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.406995 Aug 04 02:18:12.352613 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 88/181] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:11 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:13.111115 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:13.112100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:13.125260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:13.132239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:13.138683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:13.139309 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:13.373368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:13.374015 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:13.393552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:13.394248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:13.399977 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:13.400447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:13.984904 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:13.997941 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8ea6814a-a5e1-4ac6-a408-05d57e517deb tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1554 microversion: 2.1 time: 0.890640 Aug 04 02:18:13.999172 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 94/182] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:13 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1554 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:14.113363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:14.131727 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-da2a1021-1646-46b8-8ede-ff608e0e93e1 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.760343 Aug 04 02:18:14.133559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:13 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:14.637174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-7ba8a664-76d1-4c81-b13f-82376471bc92 req-31ecd309-c157-4927-a54c-1faee6ce59c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf0bb22-f917-4e62-9421-ba1c47e9fe3d", "name": "network-vif-deleted", "tag": "04b00635-c395-4a36-9c93-b89099d986b5"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:14.665740 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-7ba8a664-76d1-4c81-b13f-82376471bc92 req-31ecd309-c157-4927-a54c-1faee6ce59c5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:14.666208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-7ba8a664-76d1-4c81-b13f-82376471bc92 req-31ecd309-c157-4927-a54c-1faee6ce59c5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:14.722762 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-7ba8a664-76d1-4c81-b13f-82376471bc92 req-31ecd309-c157-4927-a54c-1faee6ce59c5 service nova] Creating event network-vif-deleted:04b00635-c395-4a36-9c93-b89099d986b5 for instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d on hv-cinder-74014 Aug 04 02:18:14.730116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-7ba8a664-76d1-4c81-b13f-82376471bc92 req-31ecd309-c157-4927-a54c-1faee6ce59c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098904 Aug 04 02:18:14.731855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 95/184] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:18:15.019811 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:15.020915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:15.027188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2016b288-0c23-43b4-a225-d5850f72646d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Action: 'create', calling method: .version_select at 0x7ff494363160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1824030816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA8GW6ScVentgrI3yU6/S77PlDy2pI4Q7B980e5KkBeLvD0MdA4S6v9ix56EPRNaQ0mizIFLhaPba2KK5+drtA0mrTz+31tvOUwY1cVCHer+X6cfA0BA6aCyghAlT5R8g=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:15.031737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:15.032432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:15.033423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:15.034100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:15.055710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-2016b288-0c23-43b4-a225-d5850f72646d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Getting quotas for project d7f54ee4ba204ceb982f8e4ad5dee102. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:18:15.070698 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-2016b288-0c23-43b4-a225-d5850f72646d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Getting quotas for user 11bf0abff172401bb62653e975c91f45 and project d7f54ee4ba204ceb982f8e4ad5dee102. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:18:15.120026 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:15.128214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2016b288-0c23-43b4-a225-d5850f72646d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.443512 Aug 04 02:18:15.130824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2fd4679a-ffa5-4c20-b498-6533481ec328 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1346 microversion: 2.1 time: 0.115425 Aug 04 02:18:15.144449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:15 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:15.144775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 90/186] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:18:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:18:15.159102 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:15.159917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:15.177763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:15.179019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:15.180807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:15.181329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:15.439134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:15.448667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ee855c47-deff-4250-bbf2-53f9e6f32bdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.297504 Aug 04 02:18:15.487414 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 97/187] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:15 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:16.151402 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:16.152117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:16.165311 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:16.165574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:16.166359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:16.166781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:16.177154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:16.252770 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:16.261837 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-288e7598-b238-49f4-8581-c2de6e852768 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1346 microversion: 2.1 time: 0.114407 Aug 04 02:18:16.262418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 91/188] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:16 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:16.479193 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:16.479801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:16.486152 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:16.486606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:16.487388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:16.487825 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:16.622418 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:16.630277 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-79dbe211-8cba-4e56-b46e-9bbc0d8c1226 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.155273 Aug 04 02:18:16.630851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 98/189] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:16 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:17.283751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:17.284366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:17.291230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:17.291678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:17.292450 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:17.292910 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:17.353518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:17.371230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cd58be55-05a3-4d6a-81ab-0b22e99aa19e tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1346 microversion: 2.1 time: 0.091020 Aug 04 02:18:17.371702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 92/190] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:17 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:17.661232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:17.662316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:17.664825 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=65 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.669952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:17.670397 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:17.671166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:17.671594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:17.802567 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:17.813399 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-24104d94-a0d0-4787-b8b5-4b718fa33335 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.162632 Aug 04 02:18:17.814524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 99/191] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:17 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:18.395406 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:18.395879 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:18.404299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:18.404866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:18.405713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:18.406220 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:18.441320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:18.441769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:18.442225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lazy-loading 'fault' on Instance uuid 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:18:18.491542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44655d95949b489088dbe48eeb8f38f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de98ffc315d4474c8b5d5370ba1fe97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:18.505750 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b9ae2ac9-2af2-4695-8e9a-fedd2f48ddc9 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 200 len: 1351 microversion: 2.1 time: 0.115221 Aug 04 02:18:18.506666 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 93/192] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:18 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:18.840137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:18.840777 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:18.847751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:18.849819 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:18.850803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:18.851842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:19.017406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:19.034497 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5fb275aa-0ea1-4163-8efc-f3be26ed224a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.198278 Aug 04 02:18:19.035847 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 100/193] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:18 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:19.527585 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:19.528217 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:19.534871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:19.535313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:19.536237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:19.536724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:19.550334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] HTTP exception thrown: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Request method failure captured: Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d HTTP/1.1 Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywj-HYGxHgEcC1RxQvf9hxgeI2SXrrOLRI30BbPnNBUo7rVmjiE0FGMn6w4qn3F34KdQORKnRLuDFOOvRusw2_Co4xXkFT3JGpR2w-OSOpWxO3ZVjSHOiKOhKmPx1f0PQKLHAUP89Gw6YIHcM1lo0PJVB_mWlsz6njY-Cl4d9-BXnc Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:18:19.555533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 44655d95949b489088dbe48eeb8f38f7 Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.557240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '2cf0bb22-f917-4e62-9421-ba1c47e9fe3d'} Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:18:19.558095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.559528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.560816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Returning 404 to user: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:18:19.560816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f066e371-462f-4d7e-896f-051954d1e6b5 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 404 len: 111 microversion: 2.1 time: 0.034125 Aug 04 02:18:19.560816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 94/194] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:19 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:18:19.688850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:19.691019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:19.697744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:19.698189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:19.698953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:19.699381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:19.716972 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] HTTP exception thrown: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Request method failure captured: Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d/os-volume_attachments HTTP/1.1 Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywj-HYGxHgEcC1RxQvf9hxgeI2SXrrOLRI30BbPnNBUo7rVmjiE0FGMn6w4qn3F34KdQORKnRLuDFOOvRusw2_Co4xXkFT3JGpR2w-OSOpWxO3ZVjSHOiKOhKmPx1f0PQKLHAUP89Gw6YIHcM1lo0PJVB_mWlsz6njY-Cl4d9-BXnc Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:18:19.722083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 44655d95949b489088dbe48eeb8f38f7 Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.723525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'server_id': '2cf0bb22-f917-4e62-9421-ba1c47e9fe3d'} Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:18:19.724307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:19.725723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:19.727044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Returning 404 to user: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:18:19.727044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b9b78fb4-6f28-4418-8f44-354bb1683c07 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038924 Aug 04 02:18:19.727044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 101/195] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:18:19 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:18:20.055670 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:20.056337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:20.062457 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:20.062906 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:20.064135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:20.064135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:20.203488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:20.211804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-de394e01-0e11-4d6a-8219-985eaf3f9591 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.160431 Aug 04 02:18:20.212364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 95/196] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:20 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:20.966548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:20.967337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:20.973885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:20.974333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:20.975109 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:20.975543 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:20.989868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] HTTP exception thrown: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Request method failure captured: Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d HTTP/1.1 Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywj-HYGxHgEcC1RxQvf9hxgeI2SXrrOLRI30BbPnNBUo7rVmjiE0FGMn6w4qn3F34KdQORKnRLuDFOOvRusw2_Co4xXkFT3JGpR2w-OSOpWxO3ZVjSHOiKOhKmPx1f0PQKLHAUP89Gw6YIHcM1lo0PJVB_mWlsz6njY-Cl4d9-BXnc Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:18:20.992636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 44655d95949b489088dbe48eeb8f38f7 Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:20.994886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '2cf0bb22-f917-4e62-9421-ba1c47e9fe3d'} Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:18:20.995818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:20.997561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:18:20.999715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Returning 404 to user: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:18:20.999715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c3d3bf25-aa7b-4dd6-8270-8c97a76b48b8 tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 404 len: 111 microversion: 2.1 time: 0.031421 Aug 04 02:18:20.999715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 102/197] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:18:20 2022] DELETE /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:18:21.004142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:21.004829 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] [instance: 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:21.011128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:21.011582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:21.012355 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:21.012828 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:21.027674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] HTTP exception thrown: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Request method failure captured: Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d HTTP/1.1 Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywj-HYGxHgEcC1RxQvf9hxgeI2SXrrOLRI30BbPnNBUo7rVmjiE0FGMn6w4qn3F34KdQORKnRLuDFOOvRusw2_Co4xXkFT3JGpR2w-OSOpWxO3ZVjSHOiKOhKmPx1f0PQKLHAUP89Gw6YIHcM1lo0PJVB_mWlsz6njY-Cl4d9-BXnc Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:18:21.029305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de98ffc315d4474c8b5d5370ba1fe97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: de98ffc315d4474c8b5d5370ba1fe97c Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1544006089 Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 44655d95949b489088dbe48eeb8f38f7 Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-DeleteServersTestJSON-1544006089-project Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:21.032205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '2cf0bb22-f917-4e62-9421-ba1c47e9fe3d'} Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:18:21.033120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. Aug 04 02:18:21.034488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:18:21.036102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] Returning 404 to user: Instance 2cf0bb22-f917-4e62-9421-ba1c47e9fe3d could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:18:21.036102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d040f4e9-a857-4bb1-90d4-5a112a80696f tempest-DeleteServersTestJSON-1544006089 tempest-DeleteServersTestJSON-1544006089-project] 10.222.0.45 "GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d" status: 404 len: 111 microversion: 2.1 time: 0.031430 Aug 04 02:18:21.036102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 96/198] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:20 2022] GET /compute/v2.1/servers/2cf0bb22-f917-4e62-9421-ba1c47e9fe3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:18:21.233603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:21.234192 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:21.240567 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:21.241149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:21.242954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:21.243395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:21.780025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:21.788520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3615c25f-d532-4797-a830-1e6d99ba73b4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.558991 Aug 04 02:18:21.789747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 103/199] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:21 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:22.809304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:22.809964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:22.828164 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:22.831700 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:22.832573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:22.833626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:22.985797 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:22.994751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d1b8f8ab-ca41-44c5-a047-a4dc2290a7c6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.189307 Aug 04 02:18:23.001110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 97/200] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:22 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:24.016123 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:24.017398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:24.026309 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:24.026754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:24.027546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:24.027979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:24.250653 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:24.259869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3c7ceb0e-71bc-48aa-9c2e-0c9626a64dc8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.247938 Aug 04 02:18:24.260469 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 104/201] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:24 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:25.282071 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:25.283563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:25.289977 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=4 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.292347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:25.293679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:25.294813 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:25.295423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:25.475204 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:25.486908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-66d3c475-09cb-46fb-a179-11940b68ab60 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.208899 Aug 04 02:18:25.487920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 98/202] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:25 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:26.507766 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:26.508548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:26.514781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:26.515353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:26.516259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:26.516923 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:26.717204 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:26.728093 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-94519a6f-1182-4a60-90b1-ac0c3eb4b9ac tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.224610 Aug 04 02:18:26.728940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 105/203] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:26 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:27.749826 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:27.750440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:27.752511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:27.758636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:27.759088 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:27.759883 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:27.760302 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:28.019915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:28.035368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cc8190e9-c2e0-486f-85ea-03624642c8fe tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.289002 Aug 04 02:18:28.036309 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 99/204] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:27 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:29.057973 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:29.058987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:29.067524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:29.072123 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:29.073370 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:29.073889 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:29.224997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:29.233255 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6f642cc5-d9da-4a90-a6ab-fc10999e2d22 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.180687 Aug 04 02:18:29.233826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 106/205] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:29 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:30.254846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:30.256135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:30.262742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:30.263192 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:30.263957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:30.264392 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:30.475146 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:30.482776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-13bd5570-310a-4fdb-9554-30232d0d16de tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.231871 Aug 04 02:18:30.483346 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 100/206] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:30 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:31.505673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:31.506297 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:31.515698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:31.516221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:31.520149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:31.520650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:31.788211 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:31.796573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-635246a4-d3b0-41f8-8288-00e980f058e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.294968 Aug 04 02:18:31.797179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 107/207] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:31 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:32.816711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:32.817342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:32.828918 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:32.829642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:32.830695 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:32.831436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:32.972867 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:32.981135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f310ac1e-cf23-40f2-ad08-195a5d2dbd4f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.168214 Aug 04 02:18:32.981710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 101/208] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:32 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:34.001794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:34.002409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:34.009280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:34.009744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:34.010519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:34.010953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:34.148858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:34.156497 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-844f18cc-3061-4092-b0ec-95c1f18a7b04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.158373 Aug 04 02:18:34.157446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 108/209] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:33 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:35.177369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:35.177901 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:35.183913 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:35.184365 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:35.185163 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:35.185605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:35.313133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:35.321095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bd01d428-a628-4009-af4d-5cd1638386e5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.147666 Aug 04 02:18:35.321665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 102/210] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:35 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:36.343000 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:36.343707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:36.350276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:36.350731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:36.352144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:36.352583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:36.483156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:36.486550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.491778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0f7127f6-5138-4adc-9728-d133c9d61063 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.153150 Aug 04 02:18:36.492363 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 109/211] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:36 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:37.511588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:37.512197 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:37.518536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:37.519094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:37.519855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:37.520286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:37.651917 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:37.660263 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0893f583-f297-43e0-b040-eed4a9048009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1522 microversion: 2.1 time: 0.151893 Aug 04 02:18:37.660263 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 103/212] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:37 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:38.681200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:38.681817 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:38.689223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:38.689675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:38.690449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:38.690930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:39.072746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:39.081332 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-59498ee0-60ab-48dd-816d-f44aa039e266 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1502 microversion: 2.1 time: 0.404636 Aug 04 02:18:39.081904 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 110/213] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:38 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:39.103136 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:39.103853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:39.111166 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:39.111686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:39.112639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:39.113119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:39.269777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:39.279005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8e3a68e3-89ec-4f28-b96f-e87cdfc2918f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1515 microversion: 2.1 time: 0.180522 Aug 04 02:18:39.279633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 104/214] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:39 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:43.868360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:43.870773 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:43.878175 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:43.878839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:43.879830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:43.880896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:43.913774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'flavor' on Instance uuid a319988c-e250-4b92-a587-cc65e764dd56 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:18:44.047728 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4c5298d8-5ae1-4fb7-ad46-d52a857925fc tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/action" status: 200 len: 32 microversion: 2.1 time: 0.184693 Aug 04 02:18:44.048776 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 111/215] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:18:43 2022] POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:18:44.058129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:44.059009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:44.066579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:44.067329 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:44.068464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:44.068966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:44.342953 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:44.352444 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-94b9ae70-2435-4fdd-b01e-a354fa09e5ab tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.298374 Aug 04 02:18:44.353237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:44 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:44.473794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-43822852", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1824030816", "security_groups": [{"name": "tempest-secgroup-smoke-1185592076"}], "networks": [{"uuid": "80d80fb8-9b97-4237-a261-dc06b8102004"}], "block_device_mapping_v2": [{"uuid": "d237f16b-6c36-4bf1-b055-3930ad4fe60b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:44.664007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] validate_networks() for [('80d80fb8-9b97-4237-a261-dc06b8102004', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:18:45.157582 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:18:45.158152 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:18:45.158465 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:18:45.158886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:18:45.159301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:18:45.168595 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:45.168975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:45.169767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:45.170387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:45.196420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Getting quotas for project d7f54ee4ba204ceb982f8e4ad5dee102. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:18:45.200454 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Getting quotas for user 11bf0abff172401bb62653e975c91f45 and project d7f54ee4ba204ceb982f8e4ad5dee102. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:18:45.278780 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:18:45.280980 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d237f16b-6c36-4bf1-b055-3930ad4fe60b',volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:18:45.375839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:45.376462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:45.387511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:45.388213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:45.390214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:45.390761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:45.477282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-85332e39-dff1-42cc-b78d-01f6a0ef243c tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007486 Aug 04 02:18:45.484540 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 112/217] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:18:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:18:45.489579 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b3f57ed2-c543-472b-9749-e7dcfe61a678 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:45.490200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b3f57ed2-c543-472b-9749-e7dcfe61a678 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:45.579656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b3f57ed2-c543-472b-9749-e7dcfe61a678 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:45.590279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b3f57ed2-c543-472b-9749-e7dcfe61a678 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1087 microversion: 2.1 time: 0.104324 Aug 04 02:18:45.606264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 113/218] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:45 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1087 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:45.662875 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:45.677583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d5c7aeb8-46a3-4f5f-8d83-7af1f44e9949 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.302519 Aug 04 02:18:45.691241 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 106/219] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:45 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:46.618160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:46.618787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:46.629046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:46.629512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:46.630648 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:46.631353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:46.699730 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:46.701042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:46.708966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:46.708966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:46.709502 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:46.710369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:46.715913 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=89 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:46.718599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:46.732259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-65da241f-8f4e-4c1c-8cbf-302bf166a9e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1193 microversion: 2.1 time: 0.117220 Aug 04 02:18:46.736803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 114/220] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:46 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:46.943730 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:46.957230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-47c4bd84-e104-4a48-9f57-103e12a20ada tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.261536 Aug 04 02:18:46.959653 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 107/221] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:46 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:47.757142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:47.757761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:47.762116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:47.766146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:47.766819 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:47.767955 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:47.768599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:47.980368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:47.981013 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:48.001792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:48.012972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:48.013957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:48.014504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:48.120576 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:48.129972 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c55e1981-7086-4423-93a2-2e0f194b1ccc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.377775 Aug 04 02:18:48.130551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 115/222] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:47 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:48.268411 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:48.277852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0c3d087d-b2c3-472e-af61-7574d3dca9ae tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.301774 Aug 04 02:18:48.278426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 108/223] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:47 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:48.628697 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-902e7b3b-d0b7-4c7d-97f4-8bd042777dfd req-44c47f24-1062-44bb-81d1-32769f23e862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:18:48.682162 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-902e7b3b-d0b7-4c7d-97f4-8bd042777dfd req-44c47f24-1062-44bb-81d1-32769f23e862 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:48.682397 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-902e7b3b-d0b7-4c7d-97f4-8bd042777dfd req-44c47f24-1062-44bb-81d1-32769f23e862 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:48.699339 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-902e7b3b-d0b7-4c7d-97f4-8bd042777dfd req-44c47f24-1062-44bb-81d1-32769f23e862 service nova] Creating event network-changed:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:18:48.706063 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-902e7b3b-d0b7-4c7d-97f4-8bd042777dfd req-44c47f24-1062-44bb-81d1-32769f23e862 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084761 Aug 04 02:18:48.707376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 116/224] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:18:49.151514 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:49.152142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:49.161895 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:49.162814 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:49.164209 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:49.166519 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:49.311587 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:49.313645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:49.338206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:49.338774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:49.340758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:49.341555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:49.545514 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:49.556859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8fd33952-219e-4430-9d7d-9548a5db53e3 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.409699 Aug 04 02:18:49.558065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 109/225] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:49 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:49.594524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:49.612887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e3f3a546-8934-48d9-962e-6f741ff05de3 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.305837 Aug 04 02:18:49.612887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 117/226] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:49 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:50.578825 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:50.579434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:50.585805 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:50.586276 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:50.587029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:50.587465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:50.630946 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:50.631664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:50.639520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:50.640071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:50.640955 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:50.641383 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:50.788754 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:50.797057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4083f74e-9f6b-4b41-98b1-6077303484e0 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.221963 Aug 04 02:18:50.797751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 110/227] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:50 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:50.821730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:50.829868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f9288cf0-5a93-4dcc-b8fa-38e5e665e9e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.202697 Aug 04 02:18:50.830970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 118/228] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:50 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:51.819780 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:51.820391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:51.826929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:51.827377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:51.828138 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:51.828584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:51.853811 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:51.854423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:51.860913 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:51.861366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:51.862141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:51.862588 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:52.014763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:52.022169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-491ed16f-55a6-4e34-815d-7c5d74ebca5f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.206189 Aug 04 02:18:52.022733 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 111/229] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:51 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:52.037500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:52.044953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d0c02b11-273b-4936-b176-86fe410cae1c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.195132 Aug 04 02:18:52.045523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 119/230] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:51 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:53.043498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:53.044050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:53.050124 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:53.050573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:53.051341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:53.051778 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:53.065998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:53.066611 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:53.073046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:53.073489 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:53.074249 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:53.074675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:53.238269 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:53.246348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-04cfef61-99cd-497c-90a6-e350278518dd tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.207408 Aug 04 02:18:53.247052 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 112/231] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:53 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:53.262075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:53.269553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6305c044-4e62-408c-8be2-e71d3bd39fc0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.207314 Aug 04 02:18:53.270119 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 120/232] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:53 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:54.266926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:54.267537 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:54.273667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:54.274619 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:54.275391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:54.275832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:54.291486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:54.292261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:54.299836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:54.300549 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:54.301421 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:54.301818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:54.489335 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:54.498670 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-505ea4a2-80e2-4559-9776-55b6ceafcd69 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.235418 Aug 04 02:18:54.499251 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 113/233] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:54 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:54.500420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:54.509261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8c0eaa53-3df6-4f3c-8a61-74a74bce1919 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.222262 Aug 04 02:18:54.510287 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 121/234] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:54 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:55.520855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:55.521458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:55.527921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:55.528375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:55.529180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:55.529621 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:55.530422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:55.531053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:55.533134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:55.539394 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:55.539836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:55.541218 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:55.541691 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:55.583563 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=8 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:55.737874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:55.745924 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-870db49a-7d83-4909-a5d0-eb1e47f9f6d8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.228925 Aug 04 02:18:55.746835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 114/235] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:55 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:55.752361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:55.760241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ae28409d-1155-4d37-b0f0-a4e6e71ccc08 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.233461 Aug 04 02:18:55.761025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 122/236] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:55 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:56.768426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:56.769152 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:56.775058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:56.775510 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:56.776294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:56.776741 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:56.781398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:56.782017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:56.788398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:56.788897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:56.789673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:56.790143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:56.918407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:56.926761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c17bfdbb-07d6-4564-945e-52e3a09576d1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.162088 Aug 04 02:18:56.927492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 115/237] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:56 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:57.090232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:57.098176 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c7c3d9b7-ec09-4f00-85dd-4dd09b8b121f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.320554 Aug 04 02:18:57.098733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 123/238] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:56 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:57.950405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:57.951024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:57.954078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=34 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:57.958053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:57.958503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:57.959533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:57.959970 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:58.113630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:58.119372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:58.123664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:58.132065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5d714ce9-a92b-4187-94ad-021a64668750 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.186746 Aug 04 02:18:58.132675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 116/239] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:57 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:58.133789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:58.134374 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:58.135181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:58.135623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:58.292667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:58.300539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8bf3e9ce-cb72-4f5d-a441-01cc6de767c5 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.184971 Aug 04 02:18:58.301347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 124/240] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:58 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:59.153884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:59.154693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:59.161064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:59.161578 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:59.162341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:59.162813 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:59.303816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:59.312850 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a9f5a990-1f87-460d-8aca-4c848a6c6bce tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.163191 Aug 04 02:18:59.313760 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 117/241] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:59 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:59.322995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:18:59.323604 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:18:59.330868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:59.331348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:59.332117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:18:59.332550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:18:59.467928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:18:59.475930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-73ffebe3-e273-46f4-96cc-5f31242474c0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.156722 Aug 04 02:18:59.476508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 125/242] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:18:59 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:00.148813 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-ba0588bc-3eff-4506-9821-3d34fbdb74fb req-33f35d5f-cdb0-4039-8dde-5d8745c7e642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "name": "network-vif-plugged", "status": "completed", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:00.162146 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-ba0588bc-3eff-4506-9821-3d34fbdb74fb req-33f35d5f-cdb0-4039-8dde-5d8745c7e642 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.162761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-ba0588bc-3eff-4506-9821-3d34fbdb74fb req-33f35d5f-cdb0-4039-8dde-5d8745c7e642 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.174415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-ba0588bc-3eff-4506-9821-3d34fbdb74fb req-33f35d5f-cdb0-4039-8dde-5d8745c7e642 service nova] Creating event network-vif-plugged:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:19:00.179806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-ba0588bc-3eff-4506-9821-3d34fbdb74fb req-33f35d5f-cdb0-4039-8dde-5d8745c7e642 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035618 Aug 04 02:19:00.180484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 118/243] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:00.333771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:00.334622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:00.341661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.342142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.343153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.343680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.498288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:00.498988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:00.505170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.505620 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.506421 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.506854 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.519164 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:00.523422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:00.530712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-610cd36a-cbe8-4c56-8aed-95404832db4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.200710 Aug 04 02:19:00.531612 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 126/244] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:00 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:00.641713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:00.649503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-04b02994-c05f-4e44-bea0-e8bcc1f348ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.155410 Aug 04 02:19:00.650691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 119/245] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:00 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:00.894474 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:00.895001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:00.902869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.903330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.904102 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:00.904546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:00.928524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f538162b-5c3e-4bb6-be27-e9517b3fdc36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/ips" status: 200 len: 151 microversion: 2.20 time: 0.037858 Aug 04 02:19:00.929130 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 127/246] 10.222.0.45 () {60 vars in 1289 bytes} [Thu Aug 4 02:19:00 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:01.555237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:01.557246 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:01.564987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:01.564987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:01.565833 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:01.566557 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:01.670823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:01.671552 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:01.678066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:01.678523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:01.679300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:01.679745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:01.717012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:01.724593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-09be88f8-6033-40f9-b313-ce4d505c9325 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.175191 Aug 04 02:19:01.725198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 120/247] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:01 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:01.810173 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:01.817945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-483aa302-4e92-4a5e-9d99-ee388d698511 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.150947 Aug 04 02:19:01.818509 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 128/248] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:01 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:02.744887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:02.745517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:02.751737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:02.752511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:02.753658 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:02.754230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:02.840342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:02.841076 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:02.858455 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:02.859344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:02.860408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:02.861114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:02.929093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:02.937859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-41b2a353-891b-42f2-a6ed-acc9cbb005f9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1259 microversion: 2.1 time: 0.196828 Aug 04 02:19:02.938832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 121/249] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:02 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:03.028663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:03.036168 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3e0c2a02-5ec4-41fc-866f-5ff81c17f017 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.200496 Aug 04 02:19:03.036770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 129/250] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:02 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:03.656590 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:03.657331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:03.665842 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.666713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:03.667753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.668490 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:03.698257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lazy-loading 'flavor' on Instance uuid a6b7c041-6233-4a90-8e9d-e2745bbb07a9 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:19:03.777495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.912166 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-04b9d721-c196-4d43-ab6f-070a7c2abacb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/action" status: 202 len: 0 microversion: 2.20 time: 0.259676 Aug 04 02:19:03.912816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 122/251] 10.222.0.45 () {62 vars in 1319 bytes} [Thu Aug 4 02:19:03 2022] POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:03.921513 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:03.922129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:03.928510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.929013 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:03.929784 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.930221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:03.960513 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:03.961296 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:03.969398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.970335 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:03.971343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:03.971964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:04.141290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.150033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.151612 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.152988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8a5cb047-5f97-4a68-b167-24c6645c5431 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.235305 Aug 04 02:19:04.153702 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 130/252] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:03 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:04.161425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:04.162250 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:04.167719 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.175508 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8cc95bc9-5a5f-4d86-915a-10101bf29e05 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1443 microversion: 2.1 time: 0.219748 Aug 04 02:19:04.175843 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:04.176279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 123/253] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:03 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1443 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:04.176420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:04.177353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:04.177795 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:04.210921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:04.214094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:04.221572 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:04.222040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:04.222815 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:04.223241 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:04.396539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.405712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ef49bc19-d87e-4ef0-ab0a-a456717b9840 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.250679 Aug 04 02:19:04.406442 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 131/254] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:04 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:04.437112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:04.444800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d2025895-f406-4176-b0dc-6bcedcfbbefa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1443 microversion: 2.1 time: 0.247827 Aug 04 02:19:04.445392 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 124/255] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:04 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1443 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:05.175521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:05.176133 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:05.184038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.184492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.185311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.185758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.427095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:05.427714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:05.435031 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.435485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.436284 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.436764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.627947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:05.639820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:05.641416 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:05.643131 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b22aecb2-972c-4ee2-835f-b1ff12ea7e59 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.471464 Aug 04 02:19:05.643992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 132/256] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:05 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:05.815373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:05.819125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5e3294de-f20b-495d-ac1f-27a25e4603d7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1501 microversion: 2.1 time: 0.396111 Aug 04 02:19:05.832716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 125/257] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:05 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:05.840580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "336b8084-7eb1-462e-98e1-5c71d4b20699"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:05.843250 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:05.849203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.849651 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.850418 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.850910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.876080 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] HTTP exception thrown: Cannot 'attach_volume' instance a319988c-e250-4b92-a587-cc65e764dd56 while it is in vm_state rescued Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Request method failure captured: Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/os-volume_attachments HTTP/1.1 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 74 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6yweJha8d3a0mRMLSWAtIPTmKmHv92QHQX1BsRhZrds99PV_C6ccb2hgsW7KnQ_6l93EBj2t803gJRcDqaPaI1SB9hvxYEgnV8ZjQjHMAiwHILZJHXM9gZrkZRpApCBEctc26JOwkpbOjfJzTfEIIvIWsOLAM0GUBv6empfTLbSaSf0 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:19:05.877948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 033f13b2943945d3abc4ff852b68d698 Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {"volumeAttachment": {"volumeId": "336b8084-7eb1-462e-98e1-5c71d4b20699"}} Aug 04 02:19:05.879240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Cannot 'attach_volume' instance a319988c-e250-4b92-a587-cc65e764dd56 while it is in vm_state rescued Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'server_id': 'a319988c-e250-4b92-a587-cc65e764dd56', 'body': {'volumeAttachment': {'volumeId': '336b8084-7eb1-462e-98e1-5c71d4b20699'}}} Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a319988c-e250-4b92-a587-cc65e764dd56 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:19:05.880038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a319988c-e250-4b92-a587-cc65e764dd56 while it is in vm_state rescued Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:19:05.881207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a319988c-e250-4b92-a587-cc65e764dd56 while it is in vm_state rescued Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Returning 409 to user: Cannot 'attach_volume' instance a319988c-e250-4b92-a587-cc65e764dd56 while it is in vm_state rescued {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aab537a0-9650-47fa-8d6e-b79d79754181 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042708 Aug 04 02:19:05.882321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 133/258] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:19:05 2022] POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 02:19:05.890853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:05.891737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:05.898340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.898792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.899735 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.900068 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.977933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f677cddc-ed9c-4d76-8106-f55cd17654bf tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/action" status: 202 len: 0 microversion: 2.1 time: 0.092034 Aug 04 02:19:05.979109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 126/259] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:19:05 2022] POST /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:19:05.989116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:05.989899 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:05.997618 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:05.998386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:05.999442 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:06.000019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:06.666440 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:06.671252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:06.672479 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:06.674917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a89f17b6-90fb-4779-b615-3d22a29d01a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1509 microversion: 2.1 time: 0.690728 Aug 04 02:19:06.675676 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 134/260] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:05 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1509 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:06.679128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:06.679573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:06.680338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:06.680963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:06.695072 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:06.695713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:06.701902 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:06.702423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:06.703118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:06.703560 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:06.727308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-571b715d-d1a9-4fdb-b5b7-3ab78cc410e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/ips" status: 200 len: 147 microversion: 2.1 time: 0.036072 Aug 04 02:19:06.728385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 135/261] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:19:06 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:07.096372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:07.107061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:07.108644 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:07.109860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3a06ae8f-efdc-4b40-bdd9-8cafb9e7dbec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.442732 Aug 04 02:19:07.110557 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 127/262] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:06 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:07.698366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:07.705005 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:07.706695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:07.707221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:07.708106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:07.708680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:07.885832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-49c4d63e-716c-44c5-902e-063c84af4191 req-df565cc7-6137-497c-bd58-feb8a7785ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:07.897493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-49c4d63e-716c-44c5-902e-063c84af4191 req-df565cc7-6137-497c-bd58-feb8a7785ede service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:07.897934 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-49c4d63e-716c-44c5-902e-063c84af4191 req-df565cc7-6137-497c-bd58-feb8a7785ede service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:07.904119 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:07.918036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a43666e5-b882-4eca-aca4-126db3ac27c7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1509 microversion: 2.1 time: 0.222793 Aug 04 02:19:07.921348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 136/263] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:07 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:07.942710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-49c4d63e-716c-44c5-902e-063c84af4191 req-df565cc7-6137-497c-bd58-feb8a7785ede service nova] Creating event network-changed:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:19:07.948385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-49c4d63e-716c-44c5-902e-063c84af4191 req-df565cc7-6137-497c-bd58-feb8a7785ede service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066895 Aug 04 02:19:07.949363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 128/264] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:19:08.133113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:08.134027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:08.141246 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:08.141984 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:08.143000 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:08.143620 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:08.308404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:08.318529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:08.320319 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:08.321565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-91b8db57-8786-4a86-9457-2cc8b6070943 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.192365 Aug 04 02:19:08.332837 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 137/265] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:08 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:08.942757 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:08.944130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:08.950824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:08.951405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:08.952208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:08.952660 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.089929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:09.098406 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8ad5ff0c-212d-42bb-a0a5-c5d1ba6047f9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1509 microversion: 2.1 time: 0.160303 Aug 04 02:19:09.099083 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 129/266] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:08 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:09.107614 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:09.108234 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:09.115369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.115816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.116592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.117060 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.140113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b53d29dd-4820-4d34-a960-ee645891a604 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/ips" status: 200 len: 150 microversion: 2.1 time: 0.036340 Aug 04 02:19:09.140696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 138/267] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:19:09 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:09.345061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:09.345744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:09.351866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.352398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.353936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.354591 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.508229 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:09.516401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:09.517932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:09.519094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d7f71600-82fd-46ee-b090-67a90ff0d10a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.177948 Aug 04 02:19:09.519653 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 130/268] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:09 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:09.939607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29411cd3-4987-47c3-8dc4-b54a63413f33"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:09.942195 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:09.948771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.949217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:09.949985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:09.950439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.121027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:10.121764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:10.129171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.129712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.130525 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.130963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.391504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:10.400562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d4892b4b-d71a-4c41-abcc-41ed5f2daf19 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1509 microversion: 2.1 time: 0.284294 Aug 04 02:19:10.401474 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 131/269] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:10 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:10.543059 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:10.543682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:10.553771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.554802 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.556784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.557592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.678076 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9897e897-6ea7-4e55-98c7-31d565ba3136 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742295 Aug 04 02:19:10.678757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 139/270] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:19:09 2022] POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:10.685689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99f82ec-1eac-4693-ae03-09f9acbe332c"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:10.691209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:10.701510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.702360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.703419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:10.704039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:10.719887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:10.729512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:10.731034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:10.734779 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1ff653bf-fba7-4632-9fe9-84cce19044ae tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.196479 Aug 04 02:19:10.741214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 132/271] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:10 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:10.996122 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a20f1f6d-9843-44d8-80d0-61a5a1983ce1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315758 Aug 04 02:19:10.996903 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 140/272] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:19:10 2022] POST /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:11.421455 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:11.421923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:11.427861 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:11.428313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:11.429116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:11.429668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:11.567515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:11.575856 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b397319c-611e-4556-87ec-fac38d1355df tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1515 microversion: 2.1 time: 0.158393 Aug 04 02:19:11.576674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 133/273] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:11 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:11.763680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:11.764661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:11.771947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:11.772404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:11.773856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:11.774357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:11.948482 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:11.956715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:11.958270 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:11.959439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b6aef31e-7eb5-49f0-9cb5-021930795d3d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.201118 Aug 04 02:19:11.960274 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 141/274] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:11 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:12.980280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7c71e40d-0693-4c91-b4b5-20138c903a25 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: .version_select at 0x7ff48f7f9ee0>, body: {"keypair": {"name": "tempest-keypair-775170040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXC0sA+Wca3N8mS5x1zhofMUaV8gNxCNxE98/C4btBWOolc8I3OM5Cu/6geqzjU6YLuSSp8kKLewCDHTH7YFom4fSXt6hiHNLZPLcV6W7eO6xafkdSMmdeYKuMvTQGzxA=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:12.983472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:12.984870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:12.991830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:12.992399 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:12.993350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:12.993862 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:12.997131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-7c71e40d-0693-4c91-b4b5-20138c903a25 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for project c61d4ea2b52c497caeb298fe8677488e. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:19:12.998516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.002326 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-7c71e40d-0693-4c91-b4b5-20138c903a25 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for user 033f13b2943945d3abc4ff852b68d698 and project c61d4ea2b52c497caeb298fe8677488e. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:19:13.029568 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7c71e40d-0693-4c91-b4b5-20138c903a25 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053840 Aug 04 02:19:13.030172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 134/275] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:19:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:13.153566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:13.163354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:13.164877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:13.167024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e551f7f1-390e-4024-8834-b2f9e2c648ea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.187388 Aug 04 02:19:13.168250 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 142/276] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:12 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:14.191958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:14.192498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:14.201776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:14.202225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:14.202996 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:14.203422 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:14.442384 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:14.451015 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:14.452699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:14.454060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d77cb2e3-dc38-4849-afa3-2d1b76420cfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.266364 Aug 04 02:19:14.454817 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 135/277] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:14 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:14.706694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1497378184", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9802934c-f69c-40a4-8c5e-9fb52ddbb971"}], "security_groups": [{"name": "tempest-securitygroup--1259445828"}], "key_name": "tempest-keypair-775170040", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:14.808318 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] validate_networks() for [('9802934c-f69c-40a4-8c5e-9fb52ddbb971', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:19:15.197031 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:19:15.197451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:19:15.197922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:19:15.198336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:19:15.198731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:19:15.207552 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:15.208007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:15.208849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:15.209286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:15.226457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:19:15.230936 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Getting quotas for user 033f13b2943945d3abc4ff852b68d698 and project c61d4ea2b52c497caeb298fe8677488e. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:19:15.242438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:19:15.244785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:19:15.291700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d9e42921-f9c9-49e0-b30e-4e547e0568c8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.589592 Aug 04 02:19:15.292525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 143/278] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:19:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:19:15.303029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-726b3fc8-adb6-40af-9d5c-05316bdfcaf0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:15.303796 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-726b3fc8-adb6-40af-9d5c-05316bdfcaf0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:15.360752 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-726b3fc8-adb6-40af-9d5c-05316bdfcaf0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:15.368117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-726b3fc8-adb6-40af-9d5c-05316bdfcaf0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1245 microversion: 2.1 time: 0.068779 Aug 04 02:19:15.368734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 136/279] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:15 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:15.479363 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:15.480099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:15.486890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:15.487412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:15.488280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:15.488748 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:15.635870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:15.643858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:15.647642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:15.647642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ab674869-6819-4f4d-955f-518d4cd3bbf5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.172071 Aug 04 02:19:15.647642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 144/280] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:15 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:16.388912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:16.390396 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:16.397563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:16.398012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:16.399063 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:16.399494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:16.617448 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:16.625353 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c0d5eecd-4d81-4c34-8930-6b01195f95d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1297 microversion: 2.1 time: 0.241184 Aug 04 02:19:16.625947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 137/281] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:16 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1297 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:16.671635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:16.672270 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:16.679894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:16.680347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:16.681170 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:16.681609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:16.819393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:16.832323 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:16.834127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:16.835757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-03d03d6e-fcbc-4936-9723-4a601e87e3b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.168079 Aug 04 02:19:16.836815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 145/282] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:16 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:17.648121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:17.649552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:17.664571 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:17.665075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:17.666428 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:17.666968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:17.738420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:17.746515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d46164ee-4046-4835-b1d0-6bbb5607b489 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1303 microversion: 2.1 time: 0.102894 Aug 04 02:19:17.747249 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 138/283] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:17 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:17.867932 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:17.873087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:17.875755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.881391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:17.882062 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:17.883099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:17.883811 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.119556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:18.129879 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:18.131407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:18.132598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dbd2a3fa-0eed-4049-957e-f71191e33d2f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.274585 Aug 04 02:19:18.133205 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 146/284] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:17 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:18.297370 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1ac791ee-5e2e-40a6-86e7-bc8621600bb0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:18.305366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ac791ee-5e2e-40a6-86e7-bc8621600bb0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.306451 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1ac791ee-5e2e-40a6-86e7-bc8621600bb0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.367463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1ac791ee-5e2e-40a6-86e7-bc8621600bb0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Going to try to stop instance {{(pid=118167) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 02:19:18.405854 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.417019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1ac791ee-5e2e-40a6-86e7-bc8621600bb0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action" status: 202 len: 0 microversion: 2.1 time: 0.123162 Aug 04 02:19:18.417923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 139/285] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:19:18 2022] POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:19:18.426040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:18.426956 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:18.433365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.434175 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.435535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.436910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.674419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:18.682604 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-16f4100b-7a18-4fc9-8783-13d21c9b0e8c tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.260704 Aug 04 02:19:18.683479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 147/286] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:18 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:18.749654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-556713f7-e515-4b25-93e7-8a057ffc1cdc req-b211def3-cd57-42f9-81f4-74b1b9de40b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:18.768376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:18.769261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:18.770218 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-556713f7-e515-4b25-93e7-8a057ffc1cdc req-b211def3-cd57-42f9-81f4-74b1b9de40b9 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.770899 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-556713f7-e515-4b25-93e7-8a057ffc1cdc req-b211def3-cd57-42f9-81f4-74b1b9de40b9 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.776613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.777470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.778483 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:18.780073 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:18.786988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-556713f7-e515-4b25-93e7-8a057ffc1cdc req-b211def3-cd57-42f9-81f4-74b1b9de40b9 service nova] Creating event network-changed:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:19:18.792468 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-556713f7-e515-4b25-93e7-8a057ffc1cdc req-b211def3-cd57-42f9-81f4-74b1b9de40b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047363 Aug 04 02:19:18.793461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 140/287] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:19.000074 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:19.007773 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a1ec00c6-d51e-46e1-82ce-bd5f16aa9712 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.244185 Aug 04 02:19:19.008347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 148/288] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:18 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:19.157247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:19.157946 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:19.164112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:19.164596 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:19.165492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:19.166604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:19.326481 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:19.335277 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:19.336824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:19.337997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-09aaf94b-4c05-451f-ba06-96e92660f0d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.186279 Aug 04 02:19:19.338562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 141/289] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:19 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:19.703532 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:19.704150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:19.710485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:19.710945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:19.711708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:19.712687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:19.845254 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:19.854081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f379002e-3943-4474-a678-bd3ca3298d63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.154472 Aug 04 02:19:19.854607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 149/290] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:19 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:20.029528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:20.030162 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:20.036232 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.036707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:20.037488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.037920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:20.170836 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:20.178407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f6329875-9247-4af8-a200-f31272f27009 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.153466 Aug 04 02:19:20.178968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 142/291] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:20 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:20.361560 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:20.362165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:20.368783 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.369217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:20.369976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.370410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:20.506876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:20.515681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:20.517232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:20.518407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7137d374-9eed-45ea-bd48-68a5e0402d75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.160864 Aug 04 02:19:20.518963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 150/292] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:20 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:20.875482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:20.876009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:20.882060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.882509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:20.883269 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:20.883705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:21.103551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:21.112651 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6edfa06e-aec3-4c53-b756-ef41a3e2baf6 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.240962 Aug 04 02:19:21.113243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 143/293] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:20 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:21.200719 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:21.201337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:21.207759 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:21.208208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:21.209046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:21.209494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:21.429017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:21.437114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0540a850-4280-4d0b-a4dc-7a7d7d0d2986 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.240998 Aug 04 02:19:21.438741 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 151/294] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:21 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:21.540696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:21.541377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:21.547639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:21.548034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:21.548842 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:21.549279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:21.689970 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:21.697971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:21.699523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:21.700704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-644d29db-87a7-48f4-827e-e5f27cf3ebeb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1742 microversion: 2.20 time: 0.164043 Aug 04 02:19:21.701255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 144/295] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:21 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:22.133757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:22.134561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:22.141080 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.141636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.142470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.142906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.277834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:22.285827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-276af3e0-259b-43a1-9082-11df8690bd77 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.156139 Aug 04 02:19:22.286585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 152/296] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:22 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:22.458338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:22.459053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:22.466296 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.466782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.467607 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.468056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.602483 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:22.609982 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3422376a-f2ef-4efb-adcc-c447442e3369 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.155626 Aug 04 02:19:22.610548 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 145/297] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:22 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:22.723208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:22.723927 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:22.731799 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.732248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.733055 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:22.733492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:22.865812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:22.877020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:22.878539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:22.879737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-104f114e-4f75-4501-86f8-1507ba86d11e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1742 microversion: 2.20 time: 0.160417 Aug 04 02:19:22.880478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 153/298] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:22 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:23.308168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:23.308806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:23.315109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.315562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:23.316363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.316832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:23.453169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:23.461552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-46a2bf6f-884d-4aac-84c5-769aa4007d46 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.157863 Aug 04 02:19:23.462745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 146/299] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:23 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:23.630231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:23.630853 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:23.636963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.637415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:23.638186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.638625 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:23.777768 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:23.785550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c907b216-645a-4e3e-8f5e-d50736767b63 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.159013 Aug 04 02:19:23.786025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 154/300] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:23 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:23.904825 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:23.905440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:23.912332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.912727 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:23.913530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:23.913974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.046033 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:24.054019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:24.055526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:24.056707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d769c187-3bd5-46a9-9907-92779a490ead tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1742 microversion: 2.20 time: 0.156933 Aug 04 02:19:24.057262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 147/301] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:23 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:24.475960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-ba754661-908e-4c2b-a6d6-355a0d19c199 req-2900e126-986d-4a61-9dfc-327f91e376ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "name": "network-vif-plugged", "status": "completed", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:24.485606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:24.486919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:24.501800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:24.502253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.503050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:24.503487 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.512352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ba754661-908e-4c2b-a6d6-355a0d19c199 req-2900e126-986d-4a61-9dfc-327f91e376ef service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:24.512835 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ba754661-908e-4c2b-a6d6-355a0d19c199 req-2900e126-986d-4a61-9dfc-327f91e376ef service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.535873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-ba754661-908e-4c2b-a6d6-355a0d19c199 req-2900e126-986d-4a61-9dfc-327f91e376ef service nova] Creating event network-vif-plugged:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:19:24.542172 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-ba754661-908e-4c2b-a6d6-355a0d19c199 req-2900e126-986d-4a61-9dfc-327f91e376ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069970 Aug 04 02:19:24.544094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 155/302] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:24.710398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:24.720597 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e2c94c3d-c36f-4864-84b1-47aab736e746 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.241001 Aug 04 02:19:24.725294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 148/303] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:24 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:24.820163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:24.823202 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:24.839327 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:24.840196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.841588 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:24.842116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:24.981908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-405a4080-2b01-4f44-a542-84b8ca336026 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: .version_select at 0x7ff48f797280>, body: {"keypair": {"name": "tempest-keypair-2054498546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZJfPzrF/osqkn2aLInshXhKDqctyMN3nYRgEnY0vdJ5QowwoJbod4jnAy+ApTE/YX5qNRnv01RNpkrEEMsmqcRV7ewJHVDJUYFH12FC9yWmZy30BH8JVGdoup/qQxi0Q=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:24.999693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-405a4080-2b01-4f44-a542-84b8ca336026 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:19:25.004771 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-405a4080-2b01-4f44-a542-84b8ca336026 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:19:25.033449 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-405a4080-2b01-4f44-a542-84b8ca336026 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055488 Aug 04 02:19:25.034282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 149/304] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:19:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:19:25.081194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:25.082068 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:25.096240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:25.097268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:25.098928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:25.099607 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:25.217870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:25.241227 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:25.427104 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:25.438256 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-78117cc5-cfce-4395-8463-9c235596ca04 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1371 microversion: 2.1 time: 0.634990 Aug 04 02:19:25.448268 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 156/305] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:24 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1371 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:25.505732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:25.516283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:25.518301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:25.519503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5732c63a-d8ee-4d6f-8613-ba2a1c34bf65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.443468 Aug 04 02:19:25.528715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 150/306] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:25 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:25.742960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:25.744719 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:25.751318 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:25.751874 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:25.752785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:25.753438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:25.917463 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:25.927004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-10b81350-f291-4373-a460-5be6ddbf16fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.188175 Aug 04 02:19:25.928602 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 157/307] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:25 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:26.470837 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:26.471775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:26.483048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.483507 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.484308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.488315 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.546650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:26.547518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:26.559812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.560670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.561906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.562568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.854350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:26.858687 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:26.866626 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:26.869692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b3f0bb65-bd2d-4361-9645-3478b1a0f253 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1566 microversion: 2.1 time: 0.402386 Aug 04 02:19:26.870928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:26.871695 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 151/308] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:26 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1566 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:26.872157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-661571d9-9770-48c5-9f29-ace12ae32c5f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.329720 Aug 04 02:19:26.874484 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 158/309] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:26 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:26.877207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-9c629fba-49cc-4abd-8b9d-6f339d7fe584 req-87ada68f-6bb6-4f1d-b83b-25f093811855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "name": "network-vif-plugged", "status": "completed", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:26.887895 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9c629fba-49cc-4abd-8b9d-6f339d7fe584 req-87ada68f-6bb6-4f1d-b83b-25f093811855 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.888333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9c629fba-49cc-4abd-8b9d-6f339d7fe584 req-87ada68f-6bb6-4f1d-b83b-25f093811855 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.902089 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-9c629fba-49cc-4abd-8b9d-6f339d7fe584 req-87ada68f-6bb6-4f1d-b83b-25f093811855 service nova] Creating event network-vif-plugged:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:19:26.903869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:26.907807 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-9c629fba-49cc-4abd-8b9d-6f339d7fe584 req-87ada68f-6bb6-4f1d-b83b-25f093811855 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034406 Aug 04 02:19:26.908338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:26.908669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 152/310] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:26.921868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.923019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.924207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.925062 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.950755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:26.951791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:26.979367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.981595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:26.982629 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:26.986231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:27.047514 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bc2e0446-d5a1-4c87-b455-cbd09d0bf0d8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149264 Aug 04 02:19:27.048108 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 159/311] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:19:26 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:19:27.063595 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1281732454", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3fd5976-8837-4886-aaff-706d72d2761f"}], "security_groups": [{"name": "tempest-securitygroup--346694590"}], "key_name": "tempest-keypair-2054498546", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:27.323381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] validate_networks() for [('c3fd5976-8837-4886-aaff-706d72d2761f', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:19:27.336056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:27.344487 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9d74caa3-2800-4fa1-9c0e-22939c76507f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.398358 Aug 04 02:19:27.345395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 153/312] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:26 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:27.912341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:27.913131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:27.922685 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:27.923143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:27.924133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:27.924377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.347359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:28.356962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:28.364968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:28.364968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bff12c51-b8f3-4fd4-b50d-44c9825a4a7d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.452005 Aug 04 02:19:28.364968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 154/313] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:27 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:19:28.371529 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:28.372149 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:28.374199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.384112 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:19:28.384757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:19:28.385266 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:19:28.385840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:19:28.386499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:19:28.391443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:28.392279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.393377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:28.393932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.404499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:28.404994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.408485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:28.409021 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.429910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:19:28.435137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:19:28.450141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:19:28.452722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:19:28.531318 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-08395892-095a-4ef3-a9c8-e539892b6705 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.473202 Aug 04 02:19:28.532251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 160/314] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:19:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:19:28.551103 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5d7b7628-0a0a-4bb4-9b78-2fe784bb7f1a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:28.551997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5d7b7628-0a0a-4bb4-9b78-2fe784bb7f1a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:28.645561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5d7b7628-0a0a-4bb4-9b78-2fe784bb7f1a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:28.657083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5d7b7628-0a0a-4bb4-9b78-2fe784bb7f1a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1242 microversion: 2.1 time: 0.112811 Aug 04 02:19:28.670747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 161/315] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:28 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:28.709117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:28.723600 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-40fda7ae-3788-4d82-b141-e9f3299bf00d tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.357025 Aug 04 02:19:28.738729 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 155/316] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:28 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:28.918139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-381985f0-d048-4ce4-b9f5-9d5cfbefea8f req-cd1328aa-6309-4280-b0a9-faf3a48b5420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:28.935259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-381985f0-d048-4ce4-b9f5-9d5cfbefea8f req-cd1328aa-6309-4280-b0a9-faf3a48b5420 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:28.943896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-381985f0-d048-4ce4-b9f5-9d5cfbefea8f req-cd1328aa-6309-4280-b0a9-faf3a48b5420 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:28.946382 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.967137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-381985f0-d048-4ce4-b9f5-9d5cfbefea8f req-cd1328aa-6309-4280-b0a9-faf3a48b5420 service nova] Creating event network-changed:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:19:28.992209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-381985f0-d048-4ce4-b9f5-9d5cfbefea8f req-cd1328aa-6309-4280-b0a9-faf3a48b5420 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068062 Aug 04 02:19:28.994101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 162/317] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:19:29.385462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:29.387215 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:29.409725 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.410672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.411866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.412567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.678860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:29.681466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:29.689379 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.690189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.691221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.691732 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.730560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:29.739903 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:29.742272 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:29.744589 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bd937055-c165-4f58-99e7-518f9b6085f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.365114 Aug 04 02:19:29.745668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 156/318] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:29 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:29.750809 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:29.751646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:29.758478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.759860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.760880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:29.761531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:29.761751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:29.770674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-376b43fb-edc8-4545-bc1d-c0085921016f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1294 microversion: 2.1 time: 0.096537 Aug 04 02:19:29.771566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 163/319] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:29 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:29.936089 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:29.954424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0c0d35b6-23e1-4ef2-9e54-b288c8eb8158 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.202388 Aug 04 02:19:29.957554 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 157/320] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:29 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:30.767930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:30.768591 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:30.778763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:30.779220 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:30.786042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:30.786784 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:30.797955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:30.799244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:30.805690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:30.806835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:30.807667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:30.812157 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:31.253949 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:31.256122 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.264485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e4f6f33a-fb04-4013-9ee4-f2612d064804 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1300 microversion: 2.1 time: 0.470801 Aug 04 02:19:31.279984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 158/321] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:30 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1300 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:31.286921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:31.287809 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:31.294812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:31.295567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:31.296656 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:31.297250 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:31.417798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:31.430487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:31.438160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:31.441912 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b55ebe6a-fc7f-4bb6-a5b0-9e973e1676b3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.677502 Aug 04 02:19:31.444518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 164/322] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:30 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:31.561100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:31.573618 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-98722a8e-17b0-4a44-b3ed-1a5f1d079168 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.291649 Aug 04 02:19:31.575688 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 159/323] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:31 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:32.289049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:32.289638 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:32.297075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.297585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.298529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.298969 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.447903 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:32.457837 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f23c1159-230e-42d5-85b6-1ac64d3d73f9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.172465 Aug 04 02:19:32.458654 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 165/324] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:32 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:32.475772 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:32.477482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:32.487719 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.488680 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.490515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.491450 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.598094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:32.599066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:32.606476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.606924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.607729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:32.608169 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:32.673710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:32.685725 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:32.687216 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:32.689115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-026d8487-b651-4d2e-939d-47e3619af0bd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.218421 Aug 04 02:19:32.690563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 160/325] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:32 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:32.785850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:32.794860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1ad150c1-0bb2-49f5-b946-2cca91f0e3fc tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.201027 Aug 04 02:19:32.795580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 166/326] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:32 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:33.479407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:33.480696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:33.487042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.487503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.488291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.488824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.639699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:33.648063 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1bfb259c-8654-4134-b141-b485b9d7705d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.172395 Aug 04 02:19:33.648658 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 161/327] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:33 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:33.713670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:33.715078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:33.722144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.722601 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.723378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.723983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.816780 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:33.818233 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:33.825671 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.826436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.827340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:33.828276 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:33.906049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:33.915457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:33.917971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:33.919641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bf8880d5-808c-43c4-88ff-f7e959c0928f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.209889 Aug 04 02:19:33.920459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 167/328] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:33 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:33.984803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:33.994674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c35146e3-4b23-431b-856c-76460f4a9199 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.181634 Aug 04 02:19:33.995385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 162/329] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:33 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:34.673814 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:34.686609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:34.686609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:34.686609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:34.686609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:34.687083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:34.836169 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:34.851730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-400a9ba9-9870-4870-9b03-cdd27a37976b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.183251 Aug 04 02:19:34.853864 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 168/330] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:34 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:34.944059 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:34.948584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:34.951261 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:34.951721 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:34.952519 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:34.952991 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:35.015479 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=10 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.026018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:35.027505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:35.042903 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:35.045148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:35.046885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:35.048195 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:35.290307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:35.301576 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:35.303219 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:35.304423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-02e650fb-a527-42f6-bfa9-348a40645cf1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.364677 Aug 04 02:19:35.305501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 163/331] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:34 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:35.361668 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:35.376433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-501d1a96-9e33-40b3-973e-dd0e5a89a75f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.358012 Aug 04 02:19:35.377074 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 169/332] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:35 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:35.719942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-36c03b86-84f2-4d04-88e0-9fb0a312f270 req-22fb196f-a0df-483c-bcd4-f93c7a4e27e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015ef38-a9bb-426d-9007-f937d566d0ca", "tag": "76de9d97-0321-4338-bbec-6a4e2b886009"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:35.745003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-36c03b86-84f2-4d04-88e0-9fb0a312f270 req-22fb196f-a0df-483c-bcd4-f93c7a4e27e3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:35.746239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-36c03b86-84f2-4d04-88e0-9fb0a312f270 req-22fb196f-a0df-483c-bcd4-f93c7a4e27e3 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:35.758691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-36c03b86-84f2-4d04-88e0-9fb0a312f270 req-22fb196f-a0df-483c-bcd4-f93c7a4e27e3 service nova] Creating event network-changed:76de9d97-0321-4338-bbec-6a4e2b886009 for instance f015ef38-a9bb-426d-9007-f937d566d0ca on hv-cinder-74014 Aug 04 02:19:35.764737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-36c03b86-84f2-4d04-88e0-9fb0a312f270 req-22fb196f-a0df-483c-bcd4-f93c7a4e27e3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048401 Aug 04 02:19:35.765570 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 164/333] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:35.877094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:35.878048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:35.885395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:35.886035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:35.886961 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:35.887423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:36.056739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:36.064118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a8bd6027-c069-45f4-bda8-59f2f03bcbe1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.190894 Aug 04 02:19:36.064700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 170/334] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:35 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:36.331857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:36.332552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:36.339077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:36.339527 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:36.340291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:36.340764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:36.400490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:36.401132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:36.407087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:36.407531 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:36.408300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:36.408759 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:36.582117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:36.590760 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:36.592258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:36.593445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d1abcb59-ab02-46d0-834e-20f60a1510fd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1737 microversion: 2.20 time: 0.265857 Aug 04 02:19:36.593997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 165/335] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:36 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:36.658073 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:36.666613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a8c87e4a-05af-4a25-b9f0-4ca35580af40 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.270089 Aug 04 02:19:36.667174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 171/336] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:36 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:37.085183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:37.086043 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:37.092565 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.093045 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.093806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.094241 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.226352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:37.234292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3035694f-bb09-4676-b8fc-64c4511d37cb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.152927 Aug 04 02:19:37.234860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 166/337] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:37 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:37.617217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:37.617836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:37.624749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.625201 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.625988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.626426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.690985 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:37.692957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:37.701894 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.702343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.703301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:37.703875 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:37.805413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:37.816599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:37.818141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:37.819301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c46cda31-7438-4923-b163-a665f318f433 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1719 microversion: 2.20 time: 0.206085 Aug 04 02:19:37.820177 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 172/338] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:37 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1719 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:37.875073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:37.889899 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a6a1619d-eef3-4bef-b1f0-6769b1b05346 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1723 microversion: 2.1 time: 0.204973 Aug 04 02:19:37.890482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 167/339] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:37 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:38.254213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:38.254828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:38.261346 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.261796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:38.262564 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.263000 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:38.420461 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.504808 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:38.512258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-182b3410-351e-4b57-91e1-2d8b9ae57c30 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.261955 Aug 04 02:19:38.512865 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 173/340] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:38 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:38.847224 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:38.848869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:38.856821 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.857266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:38.858036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.858467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:38.913770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:38.913770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:38.916041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=8 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.925816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.926311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:38.927097 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:38.927734 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.223149 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.231803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.233503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.235300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8abb9a31-6605-45ca-810c-a0fb63a083c0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1719 microversion: 2.20 time: 0.393333 Aug 04 02:19:39.236051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 168/341] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:38 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:39.285437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.297078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3d083a6b-c4a2-48ff-8c1d-6d3fc0cb6973 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1700 microversion: 2.1 time: 0.388225 Aug 04 02:19:39.298674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 174/342] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:38 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1700 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:39.327946 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6b3e29a8-1699-4b24-a3b5-9b416dd035a8 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:39.341665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b3e29a8-1699-4b24-a3b5-9b416dd035a8 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:39.342142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b3e29a8-1699-4b24-a3b5-9b416dd035a8 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.366615 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6b3e29a8-1699-4b24-a3b5-9b416dd035a8 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Going to try to start instance {{(pid=118167) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 02:19:39.413445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6b3e29a8-1699-4b24-a3b5-9b416dd035a8 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action" status: 202 len: 0 microversion: 2.1 time: 0.095802 Aug 04 02:19:39.414036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 169/343] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:19:39 2022] POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:19:39.423001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:39.423703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:39.430656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:39.431135 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.432069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:39.432510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.534185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:39.534881 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:39.542225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:39.542667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.543433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:39.543860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:39.566926 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.575025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-261599e1-6627-4bca-9d0f-3d0e643ef7ce tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1709 microversion: 2.1 time: 0.156127 Aug 04 02:19:39.575775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 175/344] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:39 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:39.689154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:39.697259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-989408e8-4ce3-4fb3-bfc4-1fa64891f50e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.166981 Aug 04 02:19:39.697825 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 170/345] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:39 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:40.260263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:40.260896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:40.267415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.267866 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.268637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.269136 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.402703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:40.410603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:40.412114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:40.413310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-80399303-3795-4a03-bef5-b243e751bf35 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1719 microversion: 2.20 time: 0.157614 Aug 04 02:19:40.413874 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 176/346] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:40 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:40.596811 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:40.597425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:40.603922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.604366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.605262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.605926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.718110 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:40.718826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:40.724972 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.725508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.726376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:40.726820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:40.743972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:40.752584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9a6d6dea-d713-4f14-90e3-d79a1fa471e7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1709 microversion: 2.1 time: 0.159655 Aug 04 02:19:40.753382 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 171/347] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:40 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:40.864202 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:40.872544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-63347eea-42cb-4890-b797-769e3c1de490 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.158290 Aug 04 02:19:40.873138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 177/348] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:40 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:41.441862 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:41.442485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:41.448966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.449415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.450201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.450636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.588140 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:41.596281 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:41.597823 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:41.599126 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9d869a16-d680-4232-b5cd-054eb0ed3611 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1719 microversion: 2.20 time: 0.166153 Aug 04 02:19:41.599691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 172/349] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:41 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:41.662544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-5971d834-818f-482c-a71d-6618a6062202 req-f3452a49-8ff7-4609-b130-d15865425d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "name": "network-vif-unplugged", "status": "completed", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:41.673264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-5971d834-818f-482c-a71d-6618a6062202 req-f3452a49-8ff7-4609-b130-d15865425d83 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.673701 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-5971d834-818f-482c-a71d-6618a6062202 req-f3452a49-8ff7-4609-b130-d15865425d83 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.685356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-5971d834-818f-482c-a71d-6618a6062202 req-f3452a49-8ff7-4609-b130-d15865425d83 service nova] Creating event network-vif-unplugged:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:19:41.691001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-5971d834-818f-482c-a71d-6618a6062202 req-f3452a49-8ff7-4609-b130-d15865425d83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032055 Aug 04 02:19:41.692784 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 178/350] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:41.776213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:41.776857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:41.782907 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.783364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.784132 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.784573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.893426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:41.894275 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:41.901183 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.901632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.902413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:41.902846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:41.912432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:41.920731 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7d5c0373-fd16-46ec-bc8d-f83b4980faf0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1709 microversion: 2.1 time: 0.148787 Aug 04 02:19:41.921307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 173/351] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:41 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:42.034982 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:42.042339 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ba0e6fa1-c05b-4f87-b688-80cb6a9375eb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.153167 Aug 04 02:19:42.042896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 179/352] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:41 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:42.623803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:42.624496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:42.632664 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:42.633114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:42.633945 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:42.635254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:42.864642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:42.874274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:42.876920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:42.878512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d5ad6a45-8a97-47ba-bc66-038225b7bf07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1719 microversion: 2.20 time: 0.260102 Aug 04 02:19:42.880093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 174/353] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:42 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:42.941385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:42.941986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:42.948276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:42.948758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:42.949531 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:42.949963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:42.954085 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:43.062764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:43.063367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:43.069316 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:43.069761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:43.070524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:43.070954 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:43.075207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:43.081679 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:43.090627 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6b1089a8-3f5c-4b4d-a7cc-b9beb48ea50a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1709 microversion: 2.1 time: 0.152918 Aug 04 02:19:43.091474 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 180/354] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:42 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:43.292562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:43.300011 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bed8264e-e51e-43c1-a561-eb8a97b6209d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.241100 Aug 04 02:19:43.300584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 175/355] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:43 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:43.901730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:43.902345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:43.908327 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:43.908830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:43.909606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:43.910050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.042929 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.050875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.052398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.053583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bde68b6d-0927-4d80-819f-24f82d25fcb4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1662 microversion: 2.20 time: 0.155816 Aug 04 02:19:44.054146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 181/356] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:43 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:44.076240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07ffde06-522d-4603-8ef5-a93e88c48b0e"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:44.078792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:44.085015 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.085467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.086482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.086915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.112676 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:44.113579 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:44.120635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.121107 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.121888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.122391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.266571 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.274669 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c8a11f1a-d17a-40bf-b801-666359568c63 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1709 microversion: 2.1 time: 0.165811 Aug 04 02:19:44.275237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 182/357] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:44 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:44.320258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:44.320894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:44.327311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.327755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.328515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.328974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.391438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-adc1910f-00c8-4630-a6a6-ea21ee39102d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319661 Aug 04 02:19:44.392192 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 176/358] 10.222.0.45 () {62 vars in 1364 bytes} [Thu Aug 4 02:19:44 2022] POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:44.467040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.474416 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-29b0a6f0-fecf-46e6-bffa-6930c7112967 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.158345 Aug 04 02:19:44.474978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 183/359] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:44 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:19:44.522639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:44.523684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:44.531242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.531844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.532938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.533446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.579952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118167) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:19:44.648502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-087b9d03-e359-450f-876e-7f50b682a57a req-7c39f07b-786e-40ba-95cc-bd1bfc30af58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015ef38-a9bb-426d-9007-f937d566d0ca", "name": "network-vif-plugged", "status": "completed", "tag": "76de9d97-0321-4338-bbec-6a4e2b886009"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:44.665376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-087b9d03-e359-450f-876e-7f50b682a57a req-7c39f07b-786e-40ba-95cc-bd1bfc30af58 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.665812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-087b9d03-e359-450f-876e-7f50b682a57a req-7c39f07b-786e-40ba-95cc-bd1bfc30af58 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.668782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fe8e537b-1d11-44a8-b57b-0391ca557045 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/action" status: 202 len: 0 microversion: 2.20 time: 0.150475 Aug 04 02:19:44.669710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 177/360] 10.222.0.45 () {62 vars in 1319 bytes} [Thu Aug 4 02:19:44 2022] POST /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:44.678898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:44.679507 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:44.680072 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-087b9d03-e359-450f-876e-7f50b682a57a req-7c39f07b-786e-40ba-95cc-bd1bfc30af58 service nova] Creating event network-vif-plugged:76de9d97-0321-4338-bbec-6a4e2b886009 for instance f015ef38-a9bb-426d-9007-f937d566d0ca on hv-cinder-74014 Aug 04 02:19:44.685566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-087b9d03-e359-450f-876e-7f50b682a57a req-7c39f07b-786e-40ba-95cc-bd1bfc30af58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040745 Aug 04 02:19:44.686742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.686908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 184/361] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:44.687201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.687978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:44.688417 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:44.872237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.887970 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.890038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:44.891238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-167a1310-99f5-4658-ba6b-64056b7636b6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1748 microversion: 2.20 time: 0.216595 Aug 04 02:19:44.908757 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 178/362] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:44 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1748 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:45.297771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:45.298556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:45.305509 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.305945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:45.307291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.307827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:45.442499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:45.450916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-80d958ff-d520-4a95-a975-e12736168791 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1713 microversion: 2.1 time: 0.157884 Aug 04 02:19:45.451488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 185/363] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:45 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:45.495936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:45.496793 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:45.502781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.503231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:45.504013 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.504454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:45.639705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:45.647334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-535431f2-7043-4066-8a8e-cbf54edc8e96 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.155923 Aug 04 02:19:45.657795 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 179/364] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:45 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:45.915762 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:45.917114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:45.924072 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.924551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:45.925375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:45.925811 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:46.074753 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:46.084517 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:46.086391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:46.087476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aa729d6d-8faf-4790-8d84-dd29a266777c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1748 microversion: 2.20 time: 0.175839 Aug 04 02:19:46.088881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 186/365] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:45 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:46.669168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:46.669784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:46.676127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:46.676583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:46.677447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:46.677889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:46.810204 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:46.817617 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-25f5bb4d-a962-465a-8da1-08a7f8ffd240 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1367 microversion: 2.1 time: 0.152894 Aug 04 02:19:46.818174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 180/366] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:46 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:47.111230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:47.111846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:47.114322 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.121545 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:47.122458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:47.123529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:47.124195 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:47.270409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:47.278787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:47.280284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:47.281459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-31da5ba4-823e-4388-97e8-ff9e25880ee8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1750 microversion: 2.20 time: 0.174126 Aug 04 02:19:47.282022 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 187/367] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:47 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:19:47.838930 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:47.840043 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:47.846320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:47.846789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:47.847551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:47.847983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:48.040291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:48.047714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0059ffc9-9a04-4ee1-9a43-037a0e90f645 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1558 microversion: 2.1 time: 0.212936 Aug 04 02:19:48.048278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 181/368] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:19:47 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:48.068603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:48.069144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:48.075651 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:48.076097 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:48.076895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:48.077369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:48.199235 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a8916a12-8ef9-46fa-8b92-da2dd0d863e4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133980 Aug 04 02:19:48.199986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 188/369] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:19:48 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:48.304267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:48.305391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:48.312285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:48.313070 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:48.314087 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:48.314862 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:48.469364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:48.480442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:48.485059 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:48.488532 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e3ed56d8-8b1f-4c05-b7e4-3ce140292c3e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.187580 Aug 04 02:19:48.489240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 182/370] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:48 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:49.381426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-0f7d28d4-1310-4b0c-a583-a96a465f3100 req-79cd3312-7826-41d9-b902-7ed2ad215473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015ef38-a9bb-426d-9007-f937d566d0ca", "tag": "76de9d97-0321-4338-bbec-6a4e2b886009"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:19:49.412189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0f7d28d4-1310-4b0c-a583-a96a465f3100 req-79cd3312-7826-41d9-b902-7ed2ad215473 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:49.412689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0f7d28d4-1310-4b0c-a583-a96a465f3100 req-79cd3312-7826-41d9-b902-7ed2ad215473 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:49.425397 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-0f7d28d4-1310-4b0c-a583-a96a465f3100 req-79cd3312-7826-41d9-b902-7ed2ad215473 service nova] Creating event network-changed:76de9d97-0321-4338-bbec-6a4e2b886009 for instance f015ef38-a9bb-426d-9007-f937d566d0ca on hv-cinder-74014 Aug 04 02:19:49.442103 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-0f7d28d4-1310-4b0c-a583-a96a465f3100 req-79cd3312-7826-41d9-b902-7ed2ad215473 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065402 Aug 04 02:19:49.443199 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 189/371] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:19:49.515540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:49.516773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:49.522868 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:49.523558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:49.524339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:49.525208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:49.729285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:49.748511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:49.750715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:49.752027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-60c9a16f-e15b-4f24-b19c-1fb6f91c7c74 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.244253 Aug 04 02:19:49.752594 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 183/372] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:49 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:50.779471 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:50.780486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:50.797100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:50.797763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:50.799036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:50.799161 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:51.091240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:51.103082 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:51.105520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:51.106949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-89d0c665-8d49-4c5b-bcee-fe639a7290d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.335261 Aug 04 02:19:51.107487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 190/373] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:50 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:52.131363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:52.131969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:52.138345 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:52.138789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:52.139563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:52.139996 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:52.298742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:52.307806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:52.309617 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:52.310800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e7944fc8-af4a-472e-a7ba-7de1ccb08970 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.183435 Aug 04 02:19:52.311354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 184/374] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:52 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:53.335180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:53.336063 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:53.343045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:53.343500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:53.344280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:53.344749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:53.484960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:53.497294 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:53.498828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:53.499994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c7c0d4d3-99cf-4f78-8b8d-ca956f2736f9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.168945 Aug 04 02:19:53.500551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 191/375] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:53 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:54.525916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:54.527702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:54.535325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:54.536056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:54.537067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:54.537673 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:54.689307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:54.698585 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:54.700110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:54.701306 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-71aadaa3-c79b-459d-aa5f-9ae75119538c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.181377 Aug 04 02:19:54.701873 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 185/376] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:54 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:55.726081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:55.726671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:55.734641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:55.735329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:55.736271 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:55.736885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:55.877636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:55.887067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:55.888584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:55.889787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5f10317b-7cd5-4895-a78a-a90cc39523ef tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.167829 Aug 04 02:19:55.890356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 192/377] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:55 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:56.920939 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:56.922866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:56.929209 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:56.929889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:56.930861 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:56.931476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:57.115584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:57.129468 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:57.131527 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:57.133073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c6652149-fa9a-47a4-bfc0-1344adef2c75 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.222209 Aug 04 02:19:57.133822 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 186/378] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:56 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:58.166654 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:58.168526 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:58.176276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:58.176528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:58.177490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:58.177927 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:58.313801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:58.323856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:58.328684 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:58.329965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dae8a34e-d34e-472f-ab30-5d372c60a45d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.175866 Aug 04 02:19:58.330865 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 193/379] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:58 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:19:59.354314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:19:59.354926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:19:59.356884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:59.361897 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:59.362425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:59.363257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:19:59.363687 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:19:59.507849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:59.516835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:59.518352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:19:59.519502 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-20b63851-8f8f-4c7b-ba9f-5df36c0aaa46 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.169460 Aug 04 02:19:59.520061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 187/380] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:19:59 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:00.544305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:00.545093 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:00.552222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:00.552699 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:00.553834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:00.553958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:00.700967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:00.709337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:00.710832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:00.712236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-702de940-6c29-48c5-8c04-4f26dfafa9a2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.173873 Aug 04 02:20:00.712815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 194/381] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:00 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:20:01.734699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:01.735301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:01.741484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:01.741955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:01.742684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:01.743114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:01.746308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:01.878917 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:01.888738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:01.890244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:01.891413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6e1c381b-8835-4586-9623-a25d50de4efa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.160607 Aug 04 02:20:01.891972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 188/382] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:01 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:02.914800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:02.915416 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:02.921971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:02.922432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:02.923259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:02.923678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:03.065224 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:03.074976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:03.076713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:03.077897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2f8bacda-73d1-482d-befa-9aa42812be2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.167716 Aug 04 02:20:03.078456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 195/383] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:02 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:04.101716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:04.102268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:04.108935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:04.109389 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:04.110163 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:04.110602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:04.239033 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:04.247633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:04.249240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:04.250395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8b0ade7e-484f-40a3-acb1-cc8824aedf69 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.152671 Aug 04 02:20:04.250952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 189/384] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:04 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:05.273191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:05.273786 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:05.280433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:05.280926 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:05.281737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:05.282207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:05.413004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:05.422019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:05.423518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:05.424746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3fe2f9ff-b5b4-4dd0-87ee-6912fc2715be tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.155348 Aug 04 02:20:05.425300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 196/385] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:05 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:06.447128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:06.447733 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:06.454592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:06.455041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:06.455804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:06.456240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:06.606135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:06.614617 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:06.616102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:06.617277 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9e95a2f1-fc59-4492-9917-fed941445bd2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.174207 Aug 04 02:20:06.617833 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 190/386] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:06 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:07.640366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:07.641048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:07.647897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:07.648344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:07.649162 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:07.649600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:07.787068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:07.795665 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:07.797213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:07.798370 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f7c80a4e-38ca-4323-8e9d-68d5f8a63792 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.162752 Aug 04 02:20:07.798927 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 197/387] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:07 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:08.822758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:08.823993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:08.830851 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:08.831314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:08.832136 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:08.832524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:08.964299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:08.972736 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:08.974269 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:08.975424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bfc51364-9206-4f57-a06e-bb6fa00464e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.158115 Aug 04 02:20:08.975980 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 191/388] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:08 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:09.998199 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:09.998747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:10.005179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:10.005656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:10.006411 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:10.006843 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:10.024457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:10.158020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:10.168328 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:10.170066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:10.171257 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9c23ac2b-48a0-4274-bbdd-2a0f93e9557b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.177458 Aug 04 02:20:10.171810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 198/389] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:09 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:10.746443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-f2c45f99-b470-41fc-a41f-e59d5585d7a8 req-de9a3dd0-ebcb-4eee-a97a-61fa40fba821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "name": "network-vif-plugged", "status": "completed", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:10.756647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f2c45f99-b470-41fc-a41f-e59d5585d7a8 req-de9a3dd0-ebcb-4eee-a97a-61fa40fba821 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:10.757116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f2c45f99-b470-41fc-a41f-e59d5585d7a8 req-de9a3dd0-ebcb-4eee-a97a-61fa40fba821 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:10.769361 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-f2c45f99-b470-41fc-a41f-e59d5585d7a8 req-de9a3dd0-ebcb-4eee-a97a-61fa40fba821 service nova] Creating event network-vif-plugged:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:20:10.774440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-f2c45f99-b470-41fc-a41f-e59d5585d7a8 req-de9a3dd0-ebcb-4eee-a97a-61fa40fba821 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Aug 04 02:20:10.775028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 192/390] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:11.193469 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:11.194075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:11.201499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:11.201954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:11.202715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:11.203148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:11.388554 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:11.397933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:11.399455 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:11.400712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-40a98519-0799-4da1-9fe5-03222b694d48 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.211139 Aug 04 02:20:11.401296 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 199/391] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:11 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:20:12.423674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:12.424364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:12.430582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:12.431027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:12.431777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:12.432206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:12.560936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:12.569668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:12.571177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:12.572343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c1a47851-7ace-4372-b33a-40597f0fc60c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.152895 Aug 04 02:20:12.572986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 193/392] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:12 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:13.595284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:13.595855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:13.602372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:13.602819 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:13.603580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:13.604011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:13.740252 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:13.750432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:13.751947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:13.753144 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dce1879e-39b2-4a42-9fa9-25c45661f609 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1806 microversion: 2.20 time: 0.161822 Aug 04 02:20:13.753704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 200/393] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:13 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:14.775932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:14.777094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:14.783123 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:14.783571 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:14.784338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:14.784812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:14.923954 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:14.932326 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:14.933870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:14.935019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-382b7d73-521c-4a32-886d-fc5052dae4df tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1793 microversion: 2.20 time: 0.162944 Aug 04 02:20:14.935600 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 194/394] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:14 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1793 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:20:24.502476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5b8f71-b539-4fe3-935a-8a9f35cd319c"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:24.505156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:24.507852 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=27 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:24.508513 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=14 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:24.515718 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:24.516166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:24.517011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:24.517452 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:24.775744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aa6b59b4-346a-4615-96ba-f207e037fc78 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277120 Aug 04 02:20:24.776387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 201/395] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:20:24 2022] POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:32.316930 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:32.319238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:32.321397 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=15 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:32.322036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=37 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:32.327923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:32.328368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:32.329158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:32.329587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:32.352588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'flavor' on Instance uuid e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:20:32.474705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cb021344-53b8-4aa5-8f15-62bf37b9422c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/action" status: 200 len: 32 microversion: 2.1 time: 0.161637 Aug 04 02:20:32.475273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 195/396] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:20:32 2022] POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:20:32.486592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:32.487378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:32.494645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:32.495217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:32.496640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:32.497091 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:32.709935 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:32.718458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ed62ed5c-9ec8-4c0f-9dda-6f4caee228f2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.236592 Aug 04 02:20:32.719278 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 202/397] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:32 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:33.552816 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:33.553399 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:33.560063 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:33.560515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:33.561308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:33.561751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:33.684310 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lazy-loading 'services' on Instance uuid 36731bfb-cc25-4fcc-8c46-b4abfad95a16 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:20:33.739190 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:33.739798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:33.747039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:33.747487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:33.748257 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:33.748725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:33.801053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a3732bcd-dca7-4a97-913f-0f91ab87e841 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments/29411cd3-4987-47c3-8dc4-b54a63413f33" status: 202 len: 0 microversion: 2.1 time: 0.252440 Aug 04 02:20:33.801699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 196/398] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:20:33 2022] DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments/29411cd3-4987-47c3-8dc4-b54a63413f33 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:33.903115 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:33.912069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a380cbb7-bfcc-49f6-b6f1-815456c1a856 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.176626 Aug 04 02:20:33.912704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 203/399] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:33 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:34.938203 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:34.939905 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:34.940696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ef296920-ee8a-4a9e-b6eb-b28c30cfe38a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:34.946482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:34.946969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:34.947498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef296920-ee8a-4a9e-b6eb-b28c30cfe38a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:34.947748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:34.947943 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef296920-ee8a-4a9e-b6eb-b28c30cfe38a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:34.948258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.005992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:20:35.006245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action (ip 10.222.0.45) !!! Aug 04 02:20:35.014078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ef296920-ee8a-4a9e-b6eb-b28c30cfe38a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Going to try to stop instance {{(pid=118168) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 02:20:35.061689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ef296920-ee8a-4a9e-b6eb-b28c30cfe38a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action" status: 202 len: 0 microversion: 2.1 time: 0.124559 Aug 04 02:20:35.062651 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 204/400] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:20:34 2022] POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:20:35.071739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:35.072450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:35.080281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.080780 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.081572 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.082020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.087667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:35.096115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-46728b38-5c6a-41c4-9f9d-433fa529000a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.165231 Aug 04 02:20:35.096838 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:34 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:35.211470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:35.220066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c7cc9dba-5ce4-46e9-b681-bb3b91d637b5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.152571 Aug 04 02:20:35.220631 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 205/402] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:35 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:35.594252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:35.594664 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:35.600779 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.601230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.601994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.602429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.624759 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e1a7db7c-92db-496c-a383-1a7bf2b426fb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/ips" status: 200 len: 151 microversion: 2.1 time: 0.035086 Aug 04 02:20:35.625320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 198/403] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:20:35 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:35.637211 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99f82ec-1eac-4693-ae03-09f9acbe332c"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:35.639659 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:35.645890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.646344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.647125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.647566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.728395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: POST /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/os-volume_attachments HTTP/1.1 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 74 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:20:35.730761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {"volumeAttachment": {"volumeId": "d99f82ec-1eac-4693-ae03-09f9acbe332c"}} Aug 04 02:20:35.732341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'server_id': 'f015ef38-a9bb-426d-9007-f937d566d0ca', 'body': {'volumeAttachment': {'volumeId': 'd99f82ec-1eac-4693-ae03-09f9acbe332c'}}} Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:35.733267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:35.734695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 400 to user: Invalid volume: volume d99f82ec-1eac-4693-ae03-09f9acbe332c is already attached to instances: f5204e1c-198d-4f48-82e4-b7235cdc9e68 {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bfed8f48-ad93-41a4-8337-bd02c6f85ddd tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099598 Aug 04 02:20:35.736134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 206/404] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:20:35 2022] POST /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:20:35.741094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:35.741595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:35.748372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.748847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.749608 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.750041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.774296 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:20:35.849304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e95dd1ad-6805-45ae-ae47-da7b769fb8d4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 204 len: 0 microversion: 2.1 time: 0.111568 Aug 04 02:20:35.850173 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 199/405] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:20:35 2022] DELETE /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:20:35.859895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:35.860760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:35.867528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.867975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:35.868774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:35.869213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:36.000222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:36.007713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-77b87b32-0ff3-4ded-adad-d98d47fbcc81 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1683 microversion: 2.1 time: 0.153058 Aug 04 02:20:36.008270 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 207/406] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:35 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:36.118525 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:36.119125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:36.125642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:36.126082 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:36.126841 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:36.127264 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:36.240916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:36.241788 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:36.248415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:36.248895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:36.249685 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:36.250138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:36.256613 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:36.264568 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1692159b-883b-4418-b335-cac44b78608b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.150248 Aug 04 02:20:36.265194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 200/407] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:36 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:36.380848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:36.388232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ad058fb5-b0fe-4e33-8625-5a26e6b50dc5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.151100 Aug 04 02:20:36.388816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 208/408] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:36 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:37.030633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:37.031154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:37.037291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.037734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.038492 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.038925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.165363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:37.172927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9369c396-9995-4b66-ae01-6565926a15e7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1683 microversion: 2.1 time: 0.146818 Aug 04 02:20:37.173489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 201/409] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:37 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:37.285635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:37.286218 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:37.292606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.293087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.293852 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.294291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.409583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:37.410193 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:37.416191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.416669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.417447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:37.417887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:37.426304 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:37.434900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fc57dc37-66f1-4ec6-bf73-0bb7ccffc34a tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.153131 Aug 04 02:20:37.435472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:37 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:37.641610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:37.654374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1de516a3-3177-4f9d-999e-232427514bdd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.248517 Aug 04 02:20:37.656040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 202/411] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:37 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:38.193696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:38.194289 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:38.203675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.204050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.204914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.205358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.304609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:38.312749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-448ab42d-144a-43b1-8540-c1c948ef1f2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 200 len: 1616 microversion: 2.1 time: 0.122952 Aug 04 02:20:38.313525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 210/412] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:38 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 1616 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:38.424738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-94362e89-0311-4234-97af-be9f08e4e30e req-d13e8c56-c7fa-4f78-bfc0-7607e27c87c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015ef38-a9bb-426d-9007-f937d566d0ca", "name": "network-vif-deleted", "tag": "76de9d97-0321-4338-bbec-6a4e2b886009"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:38.443963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-94362e89-0311-4234-97af-be9f08e4e30e req-d13e8c56-c7fa-4f78-bfc0-7607e27c87c2 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.444703 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-94362e89-0311-4234-97af-be9f08e4e30e req-d13e8c56-c7fa-4f78-bfc0-7607e27c87c2 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.457301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-94362e89-0311-4234-97af-be9f08e4e30e req-d13e8c56-c7fa-4f78-bfc0-7607e27c87c2 service nova] Creating event network-vif-deleted:76de9d97-0321-4338-bbec-6a4e2b886009 for instance f015ef38-a9bb-426d-9007-f937d566d0ca on hv-cinder-74014 Aug 04 02:20:38.457503 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:38.458069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:38.466704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-94362e89-0311-4234-97af-be9f08e4e30e req-d13e8c56-c7fa-4f78-bfc0-7607e27c87c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046405 Aug 04 02:20:38.469613 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.470142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 203/413] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:38.470846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.472267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.473134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.633801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:38.642570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-171ab32a-ce1c-4b48-9cc8-d03ed23a1cdd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.191060 Aug 04 02:20:38.643148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 211/414] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:38 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:38.676672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:38.677776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:38.685845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.686418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.687425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:38.687898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:38.823105 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:38.830940 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9d7e3a12-8e32-48e5-a9ea-6fa1e05de183 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.159173 Aug 04 02:20:38.831729 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 204/415] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:38 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:39.335835 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:39.337781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:39.346320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.346776 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:39.347555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.347995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:39.362965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca HTTP/1.1 Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:20:39.364529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:20:39.366118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'f015ef38-a9bb-426d-9007-f937d566d0ca'} Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:20:39.367001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:20:39.368425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:39.369721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:20:39.369721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-19b58a2c-0ec1-4139-b0aa-0e1c17359479 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 404 len: 111 microversion: 2.1 time: 0.035606 Aug 04 02:20:39.376375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8125fe97-7c59-4573-8e77-7fc6cc17590c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '.version_select at 0x7ff48f75e940>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:39.376695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 212/416] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:39 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:20:39.398766 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8125fe97-7c59-4573-8e77-7fc6cc17590c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054498546" status: 202 len: 0 microversion: 2.1 time: 0.026261 Aug 04 02:20:39.399819 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 205/417] 10.222.0.45 () {58 vars in 1221 bytes} [Thu Aug 4 02:20:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054498546 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:39.665664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:39.667201 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:39.676263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.677064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:39.678244 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.678978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:39.851621 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:39.856874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:39.860886 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:39.868907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0aa154d9-2152-4b2c-96ab-a5eb72860a0d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.209355 Aug 04 02:20:39.872494 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.873566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 213/418] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:39 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:39.873733 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:39.874716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:39.875312 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.014925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:40.024582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6467328d-4614-466f-9aca-8ade1781d8df tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.172280 Aug 04 02:20:40.025398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 206/419] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:39 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:40.338372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:40.338910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:40.346036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.346485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.347257 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.347696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.475469 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lazy-loading 'services' on Instance uuid f5204e1c-198d-4f48-82e4-b7235cdc9e68 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:20:40.609133 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7e8b9265-1aba-4b9c-ad92-8e6790dc1d32 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments/d99f82ec-1eac-4693-ae03-09f9acbe332c" status: 202 len: 0 microversion: 2.1 time: 0.274690 Aug 04 02:20:40.609718 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 214/420] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:20:40 2022] DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments/d99f82ec-1eac-4693-ae03-09f9acbe332c => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:40.618076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:40.620257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:40.626953 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.627588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.628367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.628834 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.661223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0297a51b-0b2a-46ce-b452-aa9c965448e6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047076 Aug 04 02:20:40.662523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 207/421] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:20:40 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:40.894659 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:40.895347 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:40.901705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.902153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.902945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:40.903378 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:40.907410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:41.044194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:41.050812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:41.051512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:41.052202 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2c0d0cc4-164a-4dd8-bec6-bf97c2f1c237 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.161718 Aug 04 02:20:41.052812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 215/422] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:40 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:41.057925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.059013 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.059852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.060363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.199298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:41.208885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8180140a-d39c-4261-bd5b-46b43647631a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.161804 Aug 04 02:20:41.209553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 208/423] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:41 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:41.674055 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:41.676290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:41.683037 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.683479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.684236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.684767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.713760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-25190bc3-ff66-4635-9f30-cf71aaef270d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043562 Aug 04 02:20:41.714334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 216/424] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:20:41 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:20:41.775057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:41.775681 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:41.782506 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.782955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.783721 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.784149 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.788325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:41.811550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:20:41.885969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-055ed5b8-d7d9-476d-a939-b99fc231371e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 204 len: 0 microversion: 2.1 time: 0.114403 Aug 04 02:20:41.886622 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 209/425] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:20:41 2022] DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:20:41.895999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:41.896915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:41.902915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.903887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:41.904686 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:41.905131 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:42.034800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:42.042528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9e759c2b-8554-4c68-8a4f-196182e1a257 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1682 microversion: 2.1 time: 0.150923 Aug 04 02:20:42.043095 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 217/426] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:41 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:42.074343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:42.075041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:42.081094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:42.081542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:42.082336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:42.082775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:42.217422 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:42.228495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c9f4bc85-573f-4aea-ae5a-3467181ef35f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.158299 Aug 04 02:20:42.229115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 210/427] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:42 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:42.232124 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:42.232774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:42.239153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:42.239595 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:42.240360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:42.240824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:42.368273 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:42.375824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1ca140a0-ed72-40f2-9e92-4957c9f29f0a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.148466 Aug 04 02:20:42.376381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 218/428] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:42 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:43.065927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:43.066447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:43.072524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.072988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.073740 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.074169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.208181 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:43.215863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a24a5da5-5ba2-4341-a777-1b6269ddf71e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1682 microversion: 2.1 time: 0.153855 Aug 04 02:20:43.216429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 211/429] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:43 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:43.250501 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:43.251101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:43.257503 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.257949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.258700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.259128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.383632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:43.391557 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7f612303-1899-4ce6-a7ef-27a89039c5e8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.145414 Aug 04 02:20:43.392288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 219/430] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:43 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:43.397995 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:43.398703 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:43.405994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.406748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.408037 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:43.408542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:43.542096 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:43.550431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-95385629-2ca8-4518-88cb-91b1e31b04ac tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.156919 Aug 04 02:20:43.551002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 212/431] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:43 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:44.237236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:44.238123 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:44.244581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.245058 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.245838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.246269 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.413828 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:44.414352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:44.422228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.423065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.424217 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.424878 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.460793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:44.471001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4464a07c-7bb9-44ee-9c5a-c786fd04ec2e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 200 len: 1614 microversion: 2.1 time: 0.237863 Aug 04 02:20:44.472147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 220/432] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:44 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 1614 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:44.571317 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:44.572210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:44.579431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.579886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.580892 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.581384 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.686655 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:44.694887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-23092a4e-7d90-4ccb-b4c5-a4da43f29832 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.285135 Aug 04 02:20:44.695404 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 213/433] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:44 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:44.796242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-e08808a4-07d1-47dd-90bd-98e3ae2a4358 req-a6f8ddb2-47d6-4a30-801f-c3d9125f7016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5204e1c-198d-4f48-82e4-b7235cdc9e68", "name": "network-vif-deleted", "tag": "8bf46035-8e5d-4c05-8c39-1534e9c498af"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:44.806647 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:44.810041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-e08808a4-07d1-47dd-90bd-98e3ae2a4358 req-a6f8ddb2-47d6-4a30-801f-c3d9125f7016 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:44.810725 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-e08808a4-07d1-47dd-90bd-98e3ae2a4358 req-a6f8ddb2-47d6-4a30-801f-c3d9125f7016 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:44.817169 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f4b25854-3b95-4d2d-8517-ba0ead2639da tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1677 microversion: 2.1 time: 0.249522 Aug 04 02:20:44.817750 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 221/434] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:44 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:44.839094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-e08808a4-07d1-47dd-90bd-98e3ae2a4358 req-a6f8ddb2-47d6-4a30-801f-c3d9125f7016 service nova] Creating event network-vif-deleted:8bf46035-8e5d-4c05-8c39-1534e9c498af for instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 on hv-cinder-74014 Aug 04 02:20:44.844947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-e08808a4-07d1-47dd-90bd-98e3ae2a4358 req-a6f8ddb2-47d6-4a30-801f-c3d9125f7016 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053858 Aug 04 02:20:44.845561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 214/435] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:20:45.494720 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:45.495472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:45.503337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.503794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:45.504671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.505048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:45.519933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 HTTP/1.1 Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:20:45.521615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:20:45.522989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'f5204e1c-198d-4f48-82e4-b7235cdc9e68'} Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:20:45.523789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:20:45.525029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:20:45.526029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:20:45.526029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1afb76d5-760f-483d-a76a-8524a1718496 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 404 len: 111 microversion: 2.1 time: 0.032662 Aug 04 02:20:45.526029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 222/436] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:45 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:20:45.533105 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3cd42231-e6ff-4135-8aab-3b8168928621 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '.version_select at 0x7ff48f75e8b0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:45.554110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3cd42231-e6ff-4135-8aab-3b8168928621 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265865914" status: 202 len: 0 microversion: 2.1 time: 0.025650 Aug 04 02:20:45.554687 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 215/437] 10.222.0.45 () {58 vars in 1218 bytes} [Thu Aug 4 02:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265865914 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:45.719600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:45.720389 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:45.727516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.728040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:45.729377 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.730149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:45.839896 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:45.841250 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:45.848747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.849221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:45.849999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:45.850432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:46.044387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:46.052343 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6f876254-03e5-4d9e-ab79-aa5d221cd6a6 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.338921 Aug 04 02:20:46.052947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 223/438] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:45 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:46.116253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:46.123783 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a97877c5-6930-434b-8344-64cc2d972e6a tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1654 microversion: 2.1 time: 0.288124 Aug 04 02:20:46.124347 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 216/439] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:45 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1654 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:46.144761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ef81ab7f-f983-434d-8ef3-659be6a91af9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:46.150994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef81ab7f-f983-434d-8ef3-659be6a91af9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:46.151543 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ef81ab7f-f983-434d-8ef3-659be6a91af9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:46.174374 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ef81ab7f-f983-434d-8ef3-659be6a91af9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Going to try to start instance {{(pid=118168) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 02:20:46.218771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ef81ab7f-f983-434d-8ef3-659be6a91af9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action" status: 202 len: 0 microversion: 2.1 time: 0.077820 Aug 04 02:20:46.219398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 224/440] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:20:46 2022] POST /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:46.227633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:46.228673 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:46.235041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:46.235485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:46.236304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:46.236844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:46.481627 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9f6bd102-62b5-486d-8ec5-dfecfecb714b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: .version_select at 0x7ff494047280>, body: {"keypair": {"name": "tempest-keypair-1607500742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbQuvDQwLSA67wFKy3yqZG0pzD1XCWWzsBfVcVmE5Fq/igaSqPTR486VUYeDhvfmYBdBd2Zah0TrI18NYUdRe1rPA4jlXSqBbMrycqvA8tG7VvvXFDuATGE4fMEO2shOA=="}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:46.496940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-9f6bd102-62b5-486d-8ec5-dfecfecb714b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:20:46.501644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-9f6bd102-62b5-486d-8ec5-dfecfecb714b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:20:46.528739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9f6bd102-62b5-486d-8ec5-dfecfecb714b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051281 Aug 04 02:20:46.529349 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 225/441] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:20:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:46.556504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:46.567090 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b240ba46-cc96-4498-ac76-061cde22c7ca tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1663 microversion: 2.1 time: 0.343374 Aug 04 02:20:46.567684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 217/442] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:46 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:47.073801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:47.074512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:47.082260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:47.082774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:47.083668 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:47.084219 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:47.221307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:47.229353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5d0d78cf-3e20-452a-97c1-919710ea4258 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.159540 Aug 04 02:20:47.229930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 226/443] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:47 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:47.591661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:47.592274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:47.598775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:47.599222 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:47.600002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:47.600435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:47.739803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:47.747926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5e1c8651-74ee-4960-a229-3f8f90d821a0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1663 microversion: 2.1 time: 0.160351 Aug 04 02:20:47.748495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 218/444] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:47 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:47.947346 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1207845252", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3fd5976-8837-4886-aaff-706d72d2761f"}], "security_groups": [{"name": "tempest-securitygroup--925722632"}], "key_name": "tempest-keypair-1607500742", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:48.062775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] validate_networks() for [('c3fd5976-8837-4886-aaff-706d72d2761f', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:20:48.253025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:48.253552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:48.260133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.260577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.261373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.261805 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.471781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:48.479791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-727b4d71-11ba-4f85-91b3-2d8cd3258c9d tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.231407 Aug 04 02:20:48.480366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 219/445] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:48 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:48.501625 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:20:48.502047 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:20:48.502525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:20:48.502928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:20:48.503382 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:20:48.512063 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.512501 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.513545 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.513858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.530454 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:20:48.534376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:20:48.545801 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:20:48.548017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:20:48.595479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4df20ac0-88d4-4c91-994d-6afb093c2868 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652303 Aug 04 02:20:48.596432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 227/446] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:20:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:20:48.607782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6e2c85b4-25cd-497a-b86b-1b56dedb19d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:48.608427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6e2c85b4-25cd-497a-b86b-1b56dedb19d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:48.661588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6e2c85b4-25cd-497a-b86b-1b56dedb19d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:48.668254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6e2c85b4-25cd-497a-b86b-1b56dedb19d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1242 microversion: 2.1 time: 0.064946 Aug 04 02:20:48.668850 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 220/447] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:48 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:48.769041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:48.769565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:48.776296 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.776789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.777591 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:48.778023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:48.917782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:48.927860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-654ba317-5146-4fb8-87dc-5fb1a23d1e89 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1667 microversion: 2.1 time: 0.162801 Aug 04 02:20:48.928444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 228/448] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:48 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:49.501935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:49.502564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:49.508721 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:49.509245 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:49.509954 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:49.510395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:49.689703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:49.690488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:49.697816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:49.698366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:49.699331 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:49.699768 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:49.737168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:49.745388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-20c7c0c2-d390-4f11-844a-340a75ee37ec tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.247361 Aug 04 02:20:49.746078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 221/449] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:49 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:49.782168 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:49.789793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1c215bc7-1f31-4374-8e6e-a9e336058a9f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1300 microversion: 2.1 time: 0.103849 Aug 04 02:20:49.790447 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 229/450] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:49 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:50.767835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:50.768480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:50.774601 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:50.775047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:50.775822 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:50.776255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:50.813355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:50.814002 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:50.821703 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:50.822185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:50.823297 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:50.823734 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:51.038984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:51.047759 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-88f5db96-32bf-4e2d-8e0c-bb68ac2f341c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.283778 Aug 04 02:20:51.048933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 222/451] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:50 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:51.073693 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:51.082080 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-105c0ac7-aaf1-434e-9eeb-ac557c6a21e9 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.274018 Aug 04 02:20:51.082766 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 230/452] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:50 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:51.120924 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-f716deed-abd9-4bee-87ad-712c21c437ba req-1260f497-ae91-4f90-b40d-13cfadde980e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ea8a47-0d01-4e68-95e5-31a9977ac13f", "tag": "366e87a4-8a21-4561-abb7-e0a8211d1d43"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:51.130518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f716deed-abd9-4bee-87ad-712c21c437ba req-1260f497-ae91-4f90-b40d-13cfadde980e service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:51.130959 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f716deed-abd9-4bee-87ad-712c21c437ba req-1260f497-ae91-4f90-b40d-13cfadde980e service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:51.143012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-f716deed-abd9-4bee-87ad-712c21c437ba req-1260f497-ae91-4f90-b40d-13cfadde980e service nova] Creating event network-changed:366e87a4-8a21-4561-abb7-e0a8211d1d43 for instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f on hv-cinder-74014 Aug 04 02:20:51.147703 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-f716deed-abd9-4bee-87ad-712c21c437ba req-1260f497-ae91-4f90-b40d-13cfadde980e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Aug 04 02:20:51.148298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 223/453] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:52.069603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:52.070145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:52.076700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:52.077145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:52.077896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:52.078329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:52.105274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:52.105998 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:52.112978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:52.113426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:52.114196 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:52.114630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:52.276008 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:52.284536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f7125146-d972-4137-830b-3d50100606a7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.218759 Aug 04 02:20:52.285132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 231/454] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:52 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:52.293061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:52.301332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d6244319-c763-4804-a436-8574dcd214f7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.200276 Aug 04 02:20:52.301897 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 224/455] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:52 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:53.306583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:53.307130 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:53.314194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:53.314651 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:53.315427 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:53.315952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:53.321010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:53.321622 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:53.328328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:53.328905 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:53.329682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:53.330123 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:53.518420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:53.522380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:53.526502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e9362c5f-5780-4b12-8216-e3e3f6fd3594 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.223799 Aug 04 02:20:53.527079 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 232/456] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:53 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:53.529855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-28a0486e-ea39-4600-9150-5642ebd5769a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.212595 Aug 04 02:20:53.530412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 225/457] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:53 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:54.128007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:54.128512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:54.134535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.134988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.135754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.136193 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.140461 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.167259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-25407972-fa22-461e-b304-776e7041d22c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments/07ffde06-522d-4603-8ef5-a93e88c48b0e" status: 200 len: 194 microversion: 2.20 time: 0.043221 Aug 04 02:20:54.167839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 233/458] 10.222.0.45 () {60 vars in 1454 bytes} [Thu Aug 4 02:20:54 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments/07ffde06-522d-4603-8ef5-a93e88c48b0e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:54.233665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:54.234157 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:54.240161 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.240609 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.241412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.241845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.320079 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lazy-loading 'services' on Instance uuid a6b7c041-6233-4a90-8e9d-e2745bbb07a9 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:20:54.383166 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.396524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cf991a1d-fce2-4469-be61-4ca0663f0a72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments/07ffde06-522d-4603-8ef5-a93e88c48b0e" status: 202 len: 0 microversion: 2.20 time: 0.166368 Aug 04 02:20:54.397191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 226/459] 10.222.0.45 () {60 vars in 1457 bytes} [Thu Aug 4 02:20:54 2022] DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments/07ffde06-522d-4603-8ef5-a93e88c48b0e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:20:54.406565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:54.408858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:54.415337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.415792 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.416566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.417035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.445167 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cfeaa9de-fbf3-4fe4-a530-299285aa2171 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043246 Aug 04 02:20:54.445730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 234/460] 10.222.0.45 () {60 vars in 1343 bytes} [Thu Aug 4 02:20:54 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:54.550785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:54.551698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:54.555206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:54.555907 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:54.558138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.559724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.561053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.562925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.564077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.570964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.571471 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.572248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:54.572877 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:54.785689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:54.790120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:54.794335 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-72c4bfc8-00a6-49a7-921e-748e470708d3 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.248335 Aug 04 02:20:54.795287 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 235/461] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:54 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:54.806875 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8b6b7840-75fd-41bb-b1e2-ca079b876455 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.263126 Aug 04 02:20:54.807582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 227/462] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:54 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:55.457854 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:55.460259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:55.468075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.468520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:55.469332 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.469765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:55.498937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b8a2ec26-fc2f-406a-bf5c-ec1cd16ffdda tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044898 Aug 04 02:20:55.499410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 236/463] 10.222.0.45 () {60 vars in 1343 bytes} [Thu Aug 4 02:20:55 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:55.815073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:55.815604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:55.821657 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.822129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:55.822889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.823325 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:55.828830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:55.829456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:55.835487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.835958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:55.836744 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:55.837185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.032432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:56.036472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:56.039911 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1bf0ee3c-277d-4486-b868-1d372c102907 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.228739 Aug 04 02:20:56.040484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 228/464] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:55 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:56.044749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-da0d7b6f-3855-4cca-9305-40a9780b2d2c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1736 microversion: 2.1 time: 0.220225 Aug 04 02:20:56.045409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 237/465] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:55 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:56.511317 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:56.513556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:56.519678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.520120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.520900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.521331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.550372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fb6b2720-f92c-4d09-a660-ce8a2b8f8cc1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042995 Aug 04 02:20:56.550925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 229/466] 10.222.0.45 () {60 vars in 1343 bytes} [Thu Aug 4 02:20:56 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:56.614641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:56.615240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:56.621311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.621796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.622568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.623039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.647876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:20:56.734053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-423ee118-55c1-4d46-b86c-57ca3f08a542 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 204 len: 0 microversion: 2.20 time: 0.122608 Aug 04 02:20:56.734550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 238/467] 10.222.0.45 () {60 vars in 1280 bytes} [Thu Aug 4 02:20:56 2022] DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 02:20:56.742598 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:56.743202 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:56.749798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.750233 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.750990 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.751418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.881524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:56.889715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:56.891207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:56.892388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d30ae6c4-22c0-4ae4-913e-9a7b25565fe7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.153608 Aug 04 02:20:56.892965 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 230/468] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:56 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:56.954287 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-88ad1fc7-24ee-4ee8-9fec-d797a15dfc5b req-888694e6-eb4c-4341-8971-d73865307760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8a47-0d01-4e68-95e5-31a9977ac13f", "name": "network-vif-plugged", "status": "completed", "tag": "366e87a4-8a21-4561-abb7-e0a8211d1d43"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:56.965400 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-88ad1fc7-24ee-4ee8-9fec-d797a15dfc5b req-888694e6-eb4c-4341-8971-d73865307760 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:56.965848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-88ad1fc7-24ee-4ee8-9fec-d797a15dfc5b req-888694e6-eb4c-4341-8971-d73865307760 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:56.979932 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-88ad1fc7-24ee-4ee8-9fec-d797a15dfc5b req-888694e6-eb4c-4341-8971-d73865307760 service nova] Creating event network-vif-plugged:366e87a4-8a21-4561-abb7-e0a8211d1d43 for instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f on hv-cinder-74014 Aug 04 02:20:56.985632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-88ad1fc7-24ee-4ee8-9fec-d797a15dfc5b req-888694e6-eb4c-4341-8971-d73865307760 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035375 Aug 04 02:20:56.986175 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 239/469] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:57.061303 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:57.061927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.066738 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:57.067461 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.068006 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.068462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.069303 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.069749 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.073745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.074193 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.074952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.075383 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.267298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:57.271319 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:57.274910 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e89c3723-7cb2-430f-bd25-c64cf737db24 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.217671 Aug 04 02:20:57.275493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 231/470] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:57 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:57.279487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-46a975cf-00f0-4008-ae0e-c0ac8608e6e7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1716 microversion: 2.1 time: 0.216811 Aug 04 02:20:57.281232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 240/471] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:57 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1716 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:57.385588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:57.386078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.392643 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.393176 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.394305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.395042 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.478072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] HTTP exception thrown: Cannot 'detach_volume' instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 while it is in vm_state rescued Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Request method failure captured: Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments/da5b8f71-b539-4fe3-935a-8a9f35cd319c HTTP/1.1 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6yweJha8d3a0mRMLSWAtIPTmKmHv92QHQX1BsRhZrds99PV_C6ccb2hgsW7KnQ_6l93EBj2t803gJRcDqaPaI1SB9hvxYEgnV8ZjQjHMAiwHILZJHXM9gZrkZRpApCBEctc26JOwkpbOjfJzTfEIIvIWsOLAM0GUBv6empfTLbSaSf0 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:20:57.479711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 033f13b2943945d3abc4ff852b68d698 Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:20:57.481236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Cannot 'detach_volume' instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 while it is in vm_state rescued Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'server_id': 'e49839e3-fa7e-4a6c-bc4b-fb2162a73f42', 'id': 'da5b8f71-b539-4fe3-935a-8a9f35cd319c'} Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:20:57.482058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 while it is in vm_state rescued Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 while it is in vm_state rescued Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:20:57.483599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Returning 409 to user: Cannot 'detach_volume' instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 while it is in vm_state rescued {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:20:57.484758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ca10b395-c73a-4156-a0c5-e63dda918a73 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments/da5b8f71-b539-4fe3-935a-8a9f35cd319c" status: 409 len: 152 microversion: 2.1 time: 0.099615 Aug 04 02:20:57.485220 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 232/472] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:20:57 2022] DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments/da5b8f71-b539-4fe3-935a-8a9f35cd319c => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 02:20:57.490437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:57.491041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.497708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.498392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.499818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.500260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.564876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cbe7e8d8-5b1d-42a7-b4f9-d264dc19ea8f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/action" status: 202 len: 0 microversion: 2.1 time: 0.078099 Aug 04 02:20:57.565406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 241/473] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:20:57 2022] POST /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:20:57.573500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:57.574115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.581495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.582230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.583008 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.583451 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.719778 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:57.727964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-09f62206-1000-499b-809b-88b78e06b5a2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1724 microversion: 2.1 time: 0.158171 Aug 04 02:20:57.728534 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 233/474] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:57 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:57.915635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:57.916330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:57.923384 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.923838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:57.925266 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:57.926052 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:58.100473 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:58.110434 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:58.112565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:58.113797 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc3d9d76-74d2-4e35-992b-669d439b34b5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1721 microversion: 2.20 time: 0.202543 Aug 04 02:20:58.116778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 242/475] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:57 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:58.296442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:58.297280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:58.309665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:58.310454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:58.311544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:58.312056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:58.451519 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:58.459188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c4bdfb89-f7a7-4d94-a2bc-c98127bd612b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1367 microversion: 2.1 time: 0.167578 Aug 04 02:20:58.459849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 234/476] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:58 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:58.748771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:58.749388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:58.751354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:58.752019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=10 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:58.757970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:58.758434 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:58.759210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:58.759655 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:58.893577 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:58.902029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ac26b108-1491-4e69-9c5d-36097b902eb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1724 microversion: 2.1 time: 0.156863 Aug 04 02:20:58.902915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 243/477] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:58 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:20:59.139299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:59.140443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:59.159937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:59.166519 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:59.172534 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.172999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.173795 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.174233 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.216029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-3a265511-12c9-41fd-9b9a-a82b2a7692a4 req-720f9504-5248-48dd-91d1-5450ff1f29a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7c041-6233-4a90-8e9d-e2745bbb07a9", "name": "network-vif-deleted", "tag": "a8bb5289-23b6-4ef4-85b6-5862d3474ffb"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:20:59.230117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-3a265511-12c9-41fd-9b9a-a82b2a7692a4 req-720f9504-5248-48dd-91d1-5450ff1f29a1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.230478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-3a265511-12c9-41fd-9b9a-a82b2a7692a4 req-720f9504-5248-48dd-91d1-5450ff1f29a1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.260551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-3a265511-12c9-41fd-9b9a-a82b2a7692a4 req-720f9504-5248-48dd-91d1-5450ff1f29a1 service nova] Creating event network-vif-deleted:a8bb5289-23b6-4ef4-85b6-5862d3474ffb for instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 on hv-cinder-74014 Aug 04 02:20:59.266367 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-3a265511-12c9-41fd-9b9a-a82b2a7692a4 req-720f9504-5248-48dd-91d1-5450ff1f29a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054239 Aug 04 02:20:59.267206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 244/478] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:59.270029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:59.280643 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:59.282242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:59.283637 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1e124636-7f3e-4836-839d-f7d27fc26154 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1654 microversion: 2.20 time: 0.150427 Aug 04 02:20:59.292922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 235/479] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:20:59 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:20:59.481206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:59.481972 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:59.488842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.489304 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.490139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.490632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.620314 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:20:59.628390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-449e2232-e979-455a-9934-27b764f6b643 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1557 microversion: 2.1 time: 0.151394 Aug 04 02:20:59.628997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 245/480] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:59 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:20:59.649552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:59.650103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:59.658014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.658470 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.659267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.659855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.742905 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f558b427-8717-47e9-9ad0-78634efda387 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097383 Aug 04 02:20:59.743503 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 236/481] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:20:59 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:20:59.925172 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:20:59.926004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:20:59.932355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.932850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:20:59.933625 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:20:59.934069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:00.191522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:00.200081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-85cfb40f-0134-407e-84db-aaa82d0a5a42 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1724 microversion: 2.1 time: 0.279384 Aug 04 02:21:00.200777 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 246/482] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:20:59 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:00.308024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:00.309320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:00.318301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:00.319181 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:00.320201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:00.320889 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:00.411776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:00.421056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:00.422787 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:00.423931 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f4d47917-281f-43e0-ab46-aff3f8b69429 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1365 microversion: 2.20 time: 0.120398 Aug 04 02:21:00.433635 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 237/483] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:00 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:01.043736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-de72170b-397f-4b0c-9caa-d3d726fe2897 req-2458667f-b8cc-4522-89b5-074b51958dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ea8a47-0d01-4e68-95e5-31a9977ac13f", "tag": "366e87a4-8a21-4561-abb7-e0a8211d1d43"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:01.054077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-de72170b-397f-4b0c-9caa-d3d726fe2897 req-2458667f-b8cc-4522-89b5-074b51958dfb service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.054519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-de72170b-397f-4b0c-9caa-d3d726fe2897 req-2458667f-b8cc-4522-89b5-074b51958dfb service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.065623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-de72170b-397f-4b0c-9caa-d3d726fe2897 req-2458667f-b8cc-4522-89b5-074b51958dfb service nova] Creating event network-changed:366e87a4-8a21-4561-abb7-e0a8211d1d43 for instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f on hv-cinder-74014 Aug 04 02:21:01.070464 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-de72170b-397f-4b0c-9caa-d3d726fe2897 req-2458667f-b8cc-4522-89b5-074b51958dfb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030437 Aug 04 02:21:01.071264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 247/484] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:01.223800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:01.225099 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:01.232324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.233769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.237405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.238984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.378327 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:01.386342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b94435d9-8623-4d77-af26-0ba4864e2ace tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1730 microversion: 2.1 time: 0.166982 Aug 04 02:21:01.386916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 238/485] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:01 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:01.410146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:01.410721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:01.417187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.417764 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.418603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.419107 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.446480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:01.447090 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:01.453441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.453894 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.454674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.455109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.488109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:01.488556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:01.489228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lazy-loading 'fault' on Instance uuid a6b7c041-6233-4a90-8e9d-e2745bbb07a9 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:01.502060 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5fde7581-8d88-479d-af3b-899b6ad2b5ba tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095770 Aug 04 02:21:01.503342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 248/486] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:21:01 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:21:01.536547 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:01.546102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:01.547748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:01.549289 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2f49059a-265f-4249-8c40-32713df7f423 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 200 len: 1370 microversion: 2.20 time: 0.106355 Aug 04 02:21:01.549978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 239/487] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:01 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:21:02.571971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:02.572674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:02.579324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:02.579780 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:02.580557 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:02.581027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:02.595707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 HTTP/1.1 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:21:02.597408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:21:02.598998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'a6b7c041-6233-4a90-8e9d-e2745bbb07a9'} Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:02.599924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:21:02.601478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:02.602890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:02.602890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-be0eff64-1340-4aad-9def-752be7b8aef1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 404 len: 111 microversion: 2.20 time: 0.031291 Aug 04 02:21:02.604112 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 249/488] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:02 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:21:02.608205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7820f9c0-bf51-4e62-8677-d00f91295463 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '.version_select at 0x7ff48f797700>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:02.630221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7820f9c0-bf51-4e62-8677-d00f91295463 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956664267" status: 204 len: 0 microversion: 2.20 time: 0.025955 Aug 04 02:21:02.630797 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 240/489] 10.222.0.45 () {60 vars in 1262 bytes} [Thu Aug 4 02:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956664267 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 02:21:03.085996 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}, {"name": "network-changed", "server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:03.100101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:03.100943 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:03.114519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:03.117590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] Creating event network-changed:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:21:03.118167 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] Creating event network-changed:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:21:03.124171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-26498785-6cc2-4a19-bfaa-f13470816657 req-3082b524-75a4-4e15-845a-e8858d744ff4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041342 Aug 04 02:21:03.125433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 250/490] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:03.446455 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-98162ba7-c3ce-4a6d-816f-83b59a7c5bfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: .version_select at 0x7ff48f655820>, body: {"keypair": {"name": "tempest-keypair-1200450374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4AHCXjHMWrWRXpnY0r34VV795nizSGrLo3VJVcs7YYtbkmbvXPvVhCAtrdDvlUEAy2beiZ827h5UXBwjFYdei3RN5ty3p6nEJJg1RYPhEGcsdsfhsAqtGssKlFavgyRQ=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:03.462911 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-98162ba7-c3ce-4a6d-816f-83b59a7c5bfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for project 11284ae13d2f4c5ba47517f672968623. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:21:03.471445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-98162ba7-c3ce-4a6d-816f-83b59a7c5bfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for user df5d3de1afa945c3b0873050eca06c0c and project 11284ae13d2f4c5ba47517f672968623. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:21:03.501985 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-98162ba7-c3ce-4a6d-816f-83b59a7c5bfd tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059643 Aug 04 02:21:03.503107 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 241/491] 10.222.0.45 () {62 vars in 1200 bytes} [Thu Aug 4 02:21:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 02:21:05.406284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-609079532", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5813221-e639-425b-a3c4-33938890da3f"}], "security_groups": [{"name": "tempest-securitygroup--1234769068"}], "key_name": "tempest-keypair-1200450374", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:05.512011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] validate_networks() for [('a5813221-e639-425b-a3c4-33938890da3f', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:21:05.881851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:21:05.882282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:21:05.882739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:21:05.883140 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:21:05.883574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:21:05.892572 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:05.893046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:05.893837 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:05.894265 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:05.917994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for project 11284ae13d2f4c5ba47517f672968623. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:21:05.922981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Getting quotas for user df5d3de1afa945c3b0873050eca06c0c and project 11284ae13d2f4c5ba47517f672968623. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:21:05.933934 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:21:05.936297 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:21:05.987215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0e2d7420-1997-42b0-9019-c2a99d61397d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.587611 Aug 04 02:21:05.988446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 251/492] 10.222.0.45 () {62 vars in 1188 bytes} [Thu Aug 4 02:21:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 02:21:05.999812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:06.000367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:06.056557 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:06.065538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:06.067336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:06.068546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4077ceff-610d-4887-b339-e5015c9e0639 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1281 microversion: 2.20 time: 0.073429 Aug 04 02:21:06.069482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 242/493] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:05 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:07.091458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:07.092083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:07.101437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:07.102005 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:07.102861 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:07.103375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:07.175985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:07.184419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:07.186052 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:07.187157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e69e0f59-efd1-4250-a191-54a9edfc700b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1341 microversion: 2.20 time: 0.099976 Aug 04 02:21:07.187715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 252/494] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:07 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:21:08.210344 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:08.211059 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:08.217934 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:08.218388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:08.224262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:08.224791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:08.361092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:08.369675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:08.371192 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:08.372353 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a4299bf5-4c1a-4cbb-95ae-af6ec94a1907 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.166063 Aug 04 02:21:08.372961 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 243/495] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:08 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:08.725798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-6a7e5e0e-8029-4c6d-8f40-1f8e3c596b2c req-c8583c62-8a63-4518-9a8f-186719e595bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:08.737718 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-6a7e5e0e-8029-4c6d-8f40-1f8e3c596b2c req-c8583c62-8a63-4518-9a8f-186719e595bd service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:08.738872 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-6a7e5e0e-8029-4c6d-8f40-1f8e3c596b2c req-c8583c62-8a63-4518-9a8f-186719e595bd service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:08.752148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-6a7e5e0e-8029-4c6d-8f40-1f8e3c596b2c req-c8583c62-8a63-4518-9a8f-186719e595bd service nova] Creating event network-changed:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:21:08.757129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-6a7e5e0e-8029-4c6d-8f40-1f8e3c596b2c req-c8583c62-8a63-4518-9a8f-186719e595bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035208 Aug 04 02:21:08.757723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 253/496] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:09.395420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:09.396236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:09.402229 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:09.402673 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:09.403438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:09.403869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:09.533243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:09.541048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:09.542555 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:09.543665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-eb8eb3cd-4195-4913-808a-6df2d896c313 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.152246 Aug 04 02:21:09.544223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 244/497] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:09 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:10.567132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:10.567757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:10.574406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:10.574856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:10.575622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:10.576086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:10.715818 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:10.724381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:10.725918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:10.727115 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4058a422-93ee-455f-a7b9-513b663f4fa9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.164586 Aug 04 02:21:10.727680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 254/498] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:10 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:11.749509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:11.750057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:11.756489 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:11.756978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:11.757743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:11.758173 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:11.889430 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:11.897961 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:11.899463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:11.900560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c4d4d8bb-11b0-41bf-bc06-87eea3c66a65 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.155230 Aug 04 02:21:11.901144 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 245/499] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:11 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:12.924422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:12.925029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:12.931433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:12.931877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:12.932660 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:12.934159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:13.068453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:13.076535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:13.078097 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:13.079244 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dda86167-6ea1-48f7-b478-79aa6bfe5f2e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.159509 Aug 04 02:21:13.079845 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 255/500] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:12 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:14.102114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:14.102652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:14.109036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:14.109488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:14.110262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:14.110710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:14.128272 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:14.237306 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:14.245125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:14.246638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:14.247746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4c1da3b2-38af-4432-aa4a-a4057ab78e86 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.149701 Aug 04 02:21:14.248300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 246/501] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:14 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:15.130771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-db30c192-69c1-4e6a-8529-820bc3622f12 req-26ed5da2-4e4b-4cd6-9d14-08e726f4782a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "name": "network-vif-plugged", "status": "completed", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:15.140906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-db30c192-69c1-4e6a-8529-820bc3622f12 req-26ed5da2-4e4b-4cd6-9d14-08e726f4782a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:15.141350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-db30c192-69c1-4e6a-8529-820bc3622f12 req-26ed5da2-4e4b-4cd6-9d14-08e726f4782a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:15.153039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-db30c192-69c1-4e6a-8529-820bc3622f12 req-26ed5da2-4e4b-4cd6-9d14-08e726f4782a service nova] Creating event network-vif-plugged:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:21:15.161301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-db30c192-69c1-4e6a-8529-820bc3622f12 req-26ed5da2-4e4b-4cd6-9d14-08e726f4782a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033789 Aug 04 02:21:15.162373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 256/502] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:15.270413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:15.271008 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:15.277358 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:15.277800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:15.278571 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:15.278999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:15.414469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:15.423080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:15.424587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:15.425720 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d58c87d2-c9fc-441d-8dc1-c59b98bf87e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.159419 Aug 04 02:21:15.426278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 247/503] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:15 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:16.444602 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:16.445476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:16.450493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:16.451192 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:16.458350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:16.458805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:16.459572 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:16.460014 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:16.591412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:16.599515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:16.601057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:16.602164 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ae6baaf3-1006-4fef-8619-610792adfc45 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1407 microversion: 2.20 time: 0.158552 Aug 04 02:21:16.602742 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 257/504] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:16 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:21:17.631964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:17.632565 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:17.634467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:17.640974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:17.641424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:17.642189 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:17.642622 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:17.777040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:17.785046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:17.786536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:17.787669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0f3d50a7-68bd-4c6c-af98-0a965229772a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1599 microversion: 2.20 time: 0.159938 Aug 04 02:21:17.788215 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 248/505] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:21:17 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:21:17.809577 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:17.810120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:17.817146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:17.817594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:17.818358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:17.818796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:17.897725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-34fa7495-78bf-4bd9-a510-cbf62670c8b1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091975 Aug 04 02:21:17.898329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 258/506] 10.222.0.45 () {60 vars in 1316 bytes} [Thu Aug 4 02:21:17 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:21:18.815181 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-97785f5f-fd9e-4aec-8da8-a2fb1a35f959 req-80f2ca2e-e117-4035-83bc-c0addf2a9cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:18.824845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-97785f5f-fd9e-4aec-8da8-a2fb1a35f959 req-80f2ca2e-e117-4035-83bc-c0addf2a9cc7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:18.825214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-97785f5f-fd9e-4aec-8da8-a2fb1a35f959 req-80f2ca2e-e117-4035-83bc-c0addf2a9cc7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:18.836281 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-97785f5f-fd9e-4aec-8da8-a2fb1a35f959 req-80f2ca2e-e117-4035-83bc-c0addf2a9cc7 service nova] Creating event network-changed:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:21:18.841580 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-97785f5f-fd9e-4aec-8da8-a2fb1a35f959 req-80f2ca2e-e117-4035-83bc-c0addf2a9cc7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 Aug 04 02:21:18.842355 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 249/507] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:25.829911 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:25.830521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:25.832485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:25.838213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:25.838666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:25.839712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:25.840150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:25.867031 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lazy-loading 'flavor' on Instance uuid 135cf505-eb65-44df-b01d-9298d43f41ee {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:25.943895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-35e727bb-c402-4a20-8355-2cd79974d4fa tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "POST /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee/action" status: 202 len: 0 microversion: 2.1 time: 0.118577 Aug 04 02:21:25.944408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 259/508] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:21:25 2022] POST /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:25.953383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:25.954101 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:25.960323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:25.960744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:25.961599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:25.962028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:26.095670 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:26.103169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5506687c-abe5-4753-aec2-d4e022b2482b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.154227 Aug 04 02:21:26.103734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 250/509] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:25 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:27.125943 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:27.126658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:27.133305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.133743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.134505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.134933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.265822 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:27.273330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bc28584d-4022-4fa4-83fc-3039e07e1e9e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.153097 Aug 04 02:21:27.273905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 260/510] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:27 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:27.379509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:27.381569 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:27.387469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.387908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.388688 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.389121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.418005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-224f4e06-d6a4-4332-8acb-051d72cfc372 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042488 Aug 04 02:21:27.418536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 251/511] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:21:27 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:21:27.489460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:27.489954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:27.496459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.497216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.497998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.498446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.524630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:21:27.599113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ca2b51e0-46ae-48d0-8c7b-f0ba0ed451ae tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 204 len: 0 microversion: 2.1 time: 0.112842 Aug 04 02:21:27.600568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 261/512] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:21:27 2022] DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:21:27.609896 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:27.610511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:27.616917 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.617357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.618112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:27.618541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:27.752799 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:27.760530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3cf2140a-de88-4fb1-96f9-ce11220c9dd5 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1673 microversion: 2.1 time: 0.155255 Aug 04 02:21:27.761139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 252/513] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:27 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:28.294996 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:28.295620 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:28.302098 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:28.302544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:28.303307 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:28.303988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:28.437887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:28.445341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f836c01c-5aec-4d67-a7a1-b88769e5715f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.154701 Aug 04 02:21:28.445902 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 262/514] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:28 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:28.782193 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:28.783357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:28.791847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:28.792293 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:28.793103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:28.793538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:28.926399 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:28.933811 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7210de71-db08-44ce-a8f4-0e8b9f1aed10 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1673 microversion: 2.1 time: 0.155529 Aug 04 02:21:28.934367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 253/515] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:28 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:29.466505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:29.467121 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:29.474979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:29.475463 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:29.476231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:29.476685 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:29.614672 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:29.622299 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e8206edf-9444-4e7b-9ab0-9edb1a927c2b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.159964 Aug 04 02:21:29.622859 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 263/516] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:29 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:29.955564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:29.956203 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:29.958170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:29.963646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:29.964352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:29.965152 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:29.965589 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:30.095676 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:30.103216 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-60918528-dc1c-4109-bec3-6ce875115819 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1673 microversion: 2.1 time: 0.151685 Aug 04 02:21:30.103786 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 254/517] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:29 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:30.643848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:30.644494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:30.651351 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:30.651790 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:30.652568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:30.653040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:30.801017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:30.809678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4925e808-7e85-4279-9f3b-7abb037d43db tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.169782 Aug 04 02:21:30.810254 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 264/518] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:30 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:30.934605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-9c8558a8-bc38-42b6-9548-e6c1738769ad req-0731492f-d852-467e-853b-5ef151f22e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36731bfb-cc25-4fcc-8c46-b4abfad95a16", "name": "network-vif-deleted", "tag": "8127a1da-4bc3-4dc9-96d0-34260651ad7e"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:30.948462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9c8558a8-bc38-42b6-9548-e6c1738769ad req-0731492f-d852-467e-853b-5ef151f22e52 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:30.949088 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9c8558a8-bc38-42b6-9548-e6c1738769ad req-0731492f-d852-467e-853b-5ef151f22e52 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:30.966372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-9c8558a8-bc38-42b6-9548-e6c1738769ad req-0731492f-d852-467e-853b-5ef151f22e52 service nova] Creating event network-vif-deleted:8127a1da-4bc3-4dc9-96d0-34260651ad7e for instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 on hv-cinder-74014 Aug 04 02:21:30.971974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-9c8558a8-bc38-42b6-9548-e6c1738769ad req-0731492f-d852-467e-853b-5ef151f22e52 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041268 Aug 04 02:21:30.972974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 255/519] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:31.124592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:31.125729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:31.131763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:31.132223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:31.133041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:31.133478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:31.165542 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:31.165909 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:31.166359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lazy-loading 'fault' on Instance uuid 36731bfb-cc25-4fcc-8c46-b4abfad95a16 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:31.214902 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:31.218986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:31.227387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f775f7f7-c96d-4865-ad22-c7bc63171216 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 200 len: 1326 microversion: 2.1 time: 0.106682 Aug 04 02:21:31.229166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 265/520] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:31 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:31.831153 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:31.831877 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:31.838240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:31.838683 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:31.839702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:31.840134 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:31.980036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:31.989297 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0151cd58-b6b0-47fe-8674-eb4984cc6985 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.162419 Aug 04 02:21:31.994081 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 256/521] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:31 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:32.252536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:32.253111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:32.260226 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:32.260710 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:32.261767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:32.261928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:32.275827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 HTTP/1.1 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:21:32.277479 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:21:32.279048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '36731bfb-cc25-4fcc-8c46-b4abfad95a16'} Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:32.279967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:21:32.282181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:32.283494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:32.283494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3a5459d3-5e15-46db-887a-be020108fbe3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 404 len: 111 microversion: 2.1 time: 0.030674 Aug 04 02:21:32.283494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 266/522] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:32 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:21:32.288387 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f073ee6d-20ff-430e-9b55-00960216074b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '.version_select at 0x7ff48f607940>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:32.307359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f073ee6d-20ff-430e-9b55-00960216074b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170385646" status: 202 len: 0 microversion: 2.1 time: 0.022688 Aug 04 02:21:32.307926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 257/523] 10.222.0.45 () {58 vars in 1218 bytes} [Thu Aug 4 02:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170385646 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:32.929514 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b7902e04-0441-479f-8bc7-32c9806df5e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: .version_select at 0x7ff48f7ad040>, body: {"keypair": {"name": "tempest-keypair-1687404033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIECnWAvDo9YC896jV2u27a8pfar9in4HNMp32+ER6KTGYXiBsYyyUGU8SudWLiS8ty8Mqga8OEWxrer97WQ96YJHCM/SvY4LS2OzbAcq5j/lRYFj3OoGx4VWmhGkR2XQ=="}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:32.945153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-b7902e04-0441-479f-8bc7-32c9806df5e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:21:32.948889 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-b7902e04-0441-479f-8bc7-32c9806df5e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for user 26e73db77d93496883b66572d6bf35f2 and project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:21:32.974500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b7902e04-0441-479f-8bc7-32c9806df5e0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048758 Aug 04 02:21:32.975099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 267/524] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:21:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:21:33.010498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:33.011124 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:33.017139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:33.017586 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:33.018363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:33.018803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:33.168702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:33.177444 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-686ad4c9-6800-4dab-90aa-c611429a3216 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.171074 Aug 04 02:21:33.178127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 258/525] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:33 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:34.198723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:34.199458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:34.206774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:34.207223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:34.207997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:34.208436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:34.247846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1195516419", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3562015-01a8-442c-9260-a631d3a466e0"}], "security_groups": [{"name": "tempest-securitygroup--2060706552"}], "key_name": "tempest-keypair-1687404033", "user_data": "}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:34.377752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:34.383498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] validate_networks() for [('f3562015-01a8-442c-9260-a631d3a466e0', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:21:34.385728 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fb1e547f-d333-4982-9d91-7fa42bcaf3a9 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.190812 Aug 04 02:21:34.386308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 268/526] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:34 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:34.759334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:21:34.759758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:21:34.760234 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:21:34.760672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:21:34.761096 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:21:34.770539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:34.770986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:34.771792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:34.772232 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:34.791839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:21:34.796043 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Getting quotas for user 26e73db77d93496883b66572d6bf35f2 and project 1c32d82cce6541718e46908eaf9b98e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:21:34.806980 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:21:34.809283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:21:34.856132 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c40e3f3f-7c5f-473f-83a2-ea98ae2a14e4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612608 Aug 04 02:21:34.856802 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 259/527] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:21:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:21:34.867528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7526a32e-e5c0-4300-ae92-40288f67ba61 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:34.868136 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7526a32e-e5c0-4300-ae92-40288f67ba61 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:34.924230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7526a32e-e5c0-4300-ae92-40288f67ba61 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:34.930970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7526a32e-e5c0-4300-ae92-40288f67ba61 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1238 microversion: 2.1 time: 0.067101 Aug 04 02:21:34.931539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 269/528] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:34 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:35.409299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:35.410190 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:35.417523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:35.417972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:35.418739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:35.419298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:35.556527 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:35.565021 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a4c2bec4-250d-4f2f-9d86-0a76e00b36e1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.159709 Aug 04 02:21:35.565596 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 260/529] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:35 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:35.951617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:35.952334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:35.962349 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:35.963186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:35.964839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:35.965961 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:36.046754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:36.055001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-341dd4af-0ec1-46b6-8291-ab2712fdcbda tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1296 microversion: 2.1 time: 0.107587 Aug 04 02:21:36.055558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 270/530] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:35 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:36.586282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:36.586931 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:36.593185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:36.593634 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:36.594623 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:36.595252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:37.083866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:37.089081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:37.093546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:37.105191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bf86bb66-1841-41dd-9b76-e419c2f48a8f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.522756 Aug 04 02:21:37.118734 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:37.119190 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:37.120062 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 261/531] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:36 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:37.120190 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:37.120640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:37.263549 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:37.271128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1a16690a-7841-48b0-a7be-3b34ee45e3ec tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.199200 Aug 04 02:21:37.271689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 271/532] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:37 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:37.428995 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-7ee2631d-8973-4ecc-a763-ee6efaf3d730 req-66a038d1-8c73-4e00-9fbe-b9fb197a0be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa887f75-631c-4fb1-bd20-1dc970e29f0c", "tag": "7a967bf2-982f-49f8-91e4-16df519c5536"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:37.438499 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-7ee2631d-8973-4ecc-a763-ee6efaf3d730 req-66a038d1-8c73-4e00-9fbe-b9fb197a0be8 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:37.438948 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-7ee2631d-8973-4ecc-a763-ee6efaf3d730 req-66a038d1-8c73-4e00-9fbe-b9fb197a0be8 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:37.449747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-7ee2631d-8973-4ecc-a763-ee6efaf3d730 req-66a038d1-8c73-4e00-9fbe-b9fb197a0be8 service nova] Creating event network-changed:7a967bf2-982f-49f8-91e4-16df519c5536 for instance fa887f75-631c-4fb1-bd20-1dc970e29f0c on hv-cinder-74014 Aug 04 02:21:37.454601 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-7ee2631d-8973-4ecc-a763-ee6efaf3d730 req-66a038d1-8c73-4e00-9fbe-b9fb197a0be8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029278 Aug 04 02:21:37.455194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 262/533] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:38.128775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:38.129840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:38.137391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:38.137869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:38.138678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:38.139118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:38.268510 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:38.276119 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-45f0d203-147f-429b-a81e-7006bddc887b tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.152780 Aug 04 02:21:38.276698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 272/534] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:38 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:38.292884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:38.293633 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:38.299959 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:38.300407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:38.301191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:38.301624 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:38.433806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:38.441932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9cc21125-8fab-4e72-af2f-ffcb6b7e7a3e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.153315 Aug 04 02:21:38.442518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 263/535] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:38 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:39.297168 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:39.298432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:39.304813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.305262 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.306034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.306470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.444352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:39.452354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f3bf0b3e-dc7b-4373-95e9-1eb6f7eb0fe1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1569 microversion: 2.1 time: 0.159099 Aug 04 02:21:39.452959 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 273/536] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:39 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:39.463210 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:39.463824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:39.470897 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.471348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.472119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.472559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.473615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:39.474214 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:39.480390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.480882 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.481663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.482107 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.529173 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118168) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:21:39.612962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-81349ae1-3884-4000-b6f0-b68e03e00132 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "POST /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee/action" status: 202 len: 0 microversion: 2.1 time: 0.142039 Aug 04 02:21:39.615050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 274/537] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:21:39 2022] POST /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:21:39.619151 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:39.634493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8d0e4cdc-52b6-4a85-a068-88d1a6d49d24 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.175088 Aug 04 02:21:39.635333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 264/538] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:39 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:39.636475 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:39.637435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:39.647404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.648291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.649619 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:39.650156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:39.792100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:39.800212 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5b6f413e-9d4a-4714-9799-b73c4e46ff2d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1577 microversion: 2.1 time: 0.172720 Aug 04 02:21:39.800963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 275/539] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:39 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:40.659758 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:40.661554 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:40.669818 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:40.670289 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:40.671080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:40.671520 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:40.807275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:40.814966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fd408b3a-02f0-45e7-9fc0-7b0218fb3029 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.163134 Aug 04 02:21:40.817175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 265/540] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:40 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:40.831839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:40.832450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:40.838573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:40.839023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:40.840040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:40.840511 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:40.970196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:40.977795 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aa7e5c3c-f0f7-44d6-83b0-96a6dbc93d82 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1519 microversion: 2.1 time: 0.159321 Aug 04 02:21:40.978367 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 276/541] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:40 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:41.516046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:41.516583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:41.522652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.523093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.523947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.524277 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.600104 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:41.604208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'services' on Instance uuid e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:41.679792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-42674cf3-ee08-4623-94f9-d6b999d191d9 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments/da5b8f71-b539-4fe3-935a-8a9f35cd319c" status: 202 len: 0 microversion: 2.1 time: 0.167557 Aug 04 02:21:41.680680 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 266/542] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:21:41 2022] DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments/da5b8f71-b539-4fe3-935a-8a9f35cd319c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:41.689580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:41.691856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:41.698220 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.698893 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.700484 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.701160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.735875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-daaa8faa-5767-4835-8d51-cd6b6f343400 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051031 Aug 04 02:21:41.736444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 277/543] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:21:41 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:41.835728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:41.836427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:41.842942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.843390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.844702 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:41.845147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:41.972671 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:41.980193 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2858cbf5-5285-4505-aa50-3d0aa479f4ff tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.148674 Aug 04 02:21:41.980790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 267/544] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:41 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:41.998684 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:41.999333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:42.006374 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.006860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.007643 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.008083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.145087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:42.153508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0a862d48-7d99-4b9b-a11f-b1e3add46cbc tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.158425 Aug 04 02:21:42.154392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 278/545] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:41 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:42.748612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:42.751039 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:42.757332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.757784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.758558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.759026 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.787301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b4744563-2f5e-4adf-9c7c-d12f89c5714f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042762 Aug 04 02:21:42.787859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 268/546] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:21:42 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:21:42.869815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:42.870334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:42.876481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.877037 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.877825 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.878255 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:42.902829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:21:42.983166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-126859de-b713-44c0-b11f-e0833de8a73f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 204 len: 0 microversion: 2.1 time: 0.117153 Aug 04 02:21:42.983760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 279/547] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:21:42 2022] DELETE /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:21:42.992260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:42.992897 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:42.999031 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:42.999483 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.000309 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.000778 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.001279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:43.001975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:43.008561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.009046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.009817 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.010258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.199679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:43.204986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:43.209009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-77337788-7a0d-48a7-a8ba-9f3c95661bb7 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1690 microversion: 2.1 time: 0.220792 Aug 04 02:21:43.210951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 269/548] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:42 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:43.212884 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c970d47c-9059-4992-ad01-36ce20b7c5f0 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.215775 Aug 04 02:21:43.213876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 280/549] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:42 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:21:43.217481 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:43.218098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:43.225009 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.225464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.226235 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.226679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.361298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-2eb20373-ab7b-44b9-9563-ce555abaa1bf req-f4108187-5353-4159-9a7c-661ccf159c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "name": "network-vif-unplugged", "status": "completed", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:43.370454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:43.371449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-2eb20373-ab7b-44b9-9563-ce555abaa1bf req-f4108187-5353-4159-9a7c-661ccf159c21 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:43.372029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-2eb20373-ab7b-44b9-9563-ce555abaa1bf req-f4108187-5353-4159-9a7c-661ccf159c21 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:43.379798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3390913c-4a8b-4418-9670-6865a688ff07 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.167641 Aug 04 02:21:43.380501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 270/550] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:43 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:43.394860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-2eb20373-ab7b-44b9-9563-ce555abaa1bf req-f4108187-5353-4159-9a7c-661ccf159c21 service nova] Creating event network-vif-unplugged:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:21:43.401083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-2eb20373-ab7b-44b9-9563-ce555abaa1bf req-f4108187-5353-4159-9a7c-661ccf159c21 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043174 Aug 04 02:21:43.401758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 281/551] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:21:44.240107 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:44.240763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:44.243059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:44.243756 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:44.247398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.247779 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.248564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.249025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.249974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.250565 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.251375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.251823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.449123 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:44.453403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:44.457131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2e2574f8-fc3f-496e-87d0-719a83cfade4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1690 microversion: 2.1 time: 0.220833 Aug 04 02:21:44.457691 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 271/552] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:44 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:44.468765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-989c77be-18de-4ef3-b4c3-81e1196ce178 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.223021 Aug 04 02:21:44.468765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 282/553] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:44 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:21:44.468765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:44.468765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:44.473085 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.473532 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.474295 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:44.474730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:44.478751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:44.624364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:44.632502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-08f069b8-07f1-4fcf-a022-90a6d04b902f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.169527 Aug 04 02:21:44.633112 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 283/554] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:44 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:45.431717 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-d5afa249-0382-4191-b28a-c7928b68557d req-81750e4b-ddcf-42c5-b940-a831e28c8221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa887f75-631c-4fb1-bd20-1dc970e29f0c", "name": "network-vif-plugged", "status": "completed", "tag": "7a967bf2-982f-49f8-91e4-16df519c5536"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:45.437063 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:45.437737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:45.444578 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d5afa249-0382-4191-b28a-c7928b68557d req-81750e4b-ddcf-42c5-b940-a831e28c8221 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.445050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d5afa249-0382-4191-b28a-c7928b68557d req-81750e4b-ddcf-42c5-b940-a831e28c8221 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.456784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-d5afa249-0382-4191-b28a-c7928b68557d req-81750e4b-ddcf-42c5-b940-a831e28c8221 service nova] Creating event network-vif-plugged:7a967bf2-982f-49f8-91e4-16df519c5536 for instance fa887f75-631c-4fb1-bd20-1dc970e29f0c on hv-cinder-74014 Aug 04 02:21:45.462221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-d5afa249-0382-4191-b28a-c7928b68557d req-81750e4b-ddcf-42c5-b940-a831e28c8221 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034113 Aug 04 02:21:45.462817 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 272/555] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:45.479024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:45.479762 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:45.481737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:45.482308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:45.483100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:45.488630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.489094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.489975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.490093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.490290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.490464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.491239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.491682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.688569 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:45.691810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:45.696511 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-84fa7417-8490-4633-a7cb-57def0dd92dd tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.218296 Aug 04 02:21:45.697117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 273/556] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:45 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:21:45.701415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-46626c5b-28c8-4a9e-afdb-924799167af2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1690 microversion: 2.1 time: 0.226184 Aug 04 02:21:45.701582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:45.715440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:45.715680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 284/557] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:45 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:45.715680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:45.715680 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:45.715943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.715943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.715943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.715943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.716272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.716272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.716272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:45.716743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:45.733359 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4aef2de0-0434-45d6-b3f9-0768ddb6840c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/ips" status: 200 len: 148 microversion: 2.1 time: 0.035210 Aug 04 02:21:45.734104 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 274/558] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:21:45 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:45.853033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:45.860879 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3d2371a9-668c-4c1e-b7a6-1b157cd29a1e tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.157487 Aug 04 02:21:45.861665 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 285/559] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:45 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:46.719549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:46.720092 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:46.722752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:46.723369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:46.726225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:46.726689 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:46.727463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:46.727903 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:46.729921 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:46.730373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:46.731142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:46.731584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:46.981705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:46.989155 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7d2b918b-1e58-45ec-a1cc-c89a7f93fc6b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.273567 Aug 04 02:21:46.989734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 275/560] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:46 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:46.994351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:46.994960 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:47.000359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:47.007547 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:47.007999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:47.008588 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-99f41c6a-b8e3-48ef-9ba7-9414de7810a0 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1690 microversion: 2.1 time: 0.289544 Aug 04 02:21:47.008815 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:47.009207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 286/561] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:46 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:47.009348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:47.086415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1bfa52-a127-4fed-a030-b303d9812ac2"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:47.088805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:47.095528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:47.095991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:47.096786 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:47.097226 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:47.238660 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:47.246171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-282661fd-0801-493c-a115-c4789f272453 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.255475 Aug 04 02:21:47.246761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 276/562] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:46 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:47.537860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-163103a3-cdcb-4ca1-be28-d52894e5fc5a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455213 Aug 04 02:21:47.538528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 287/563] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:21:47 2022] POST /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:47.856197 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-a2b91294-c148-4514-b7c3-9367fbab88e7 req-2dc06c22-1f8f-448c-8590-70352ecef5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49839e3-fa7e-4a6c-bc4b-fb2162a73f42", "name": "network-vif-deleted", "tag": "a78228f0-3195-400c-857e-00c43eaf3684"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:47.866012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a2b91294-c148-4514-b7c3-9367fbab88e7 req-2dc06c22-1f8f-448c-8590-70352ecef5f5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:47.866460 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a2b91294-c148-4514-b7c3-9367fbab88e7 req-2dc06c22-1f8f-448c-8590-70352ecef5f5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:47.877681 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-a2b91294-c148-4514-b7c3-9367fbab88e7 req-2dc06c22-1f8f-448c-8590-70352ecef5f5 service nova] Creating event network-vif-deleted:a78228f0-3195-400c-857e-00c43eaf3684 for instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 on hv-cinder-74014 Aug 04 02:21:47.882764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-a2b91294-c148-4514-b7c3-9367fbab88e7 req-2dc06c22-1f8f-448c-8590-70352ecef5f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030734 Aug 04 02:21:47.883357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 277/564] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:48.011543 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:48.012975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:48.019678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.020256 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.021328 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.021908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.031001 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:48.032055 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:48.039922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.040373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.041259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.041690 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.134410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:48.143566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a759ea6a-dda9-4e8e-ab8a-a5b528a4f213 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1622 microversion: 2.1 time: 0.115962 Aug 04 02:21:48.144159 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 278/565] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:48 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1622 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:48.197698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:48.206632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-254469f2-80bd-465f-8798-4ff650b7ac06 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1364 microversion: 2.1 time: 0.199729 Aug 04 02:21:48.207600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 288/566] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:48 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:48.266743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:48.267869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:48.274158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.274530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.275298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:48.275773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:48.427675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:48.436651 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-55c4e274-5659-443f-883f-3b02c59d81ec tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.173651 Aug 04 02:21:48.438109 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 279/567] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:48 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:49.164632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:49.165249 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:49.171754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.172205 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.173496 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.173940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.204045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.204556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.205032 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'fault' on Instance uuid e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:49.228402 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:49.229143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:49.235253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.236391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.237304 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.237804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.244884 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:49.253050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dffcbfcb-b095-4fff-8003-be5bfe540c8c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 200 len: 1335 microversion: 2.1 time: 0.092316 Aug 04 02:21:49.253625 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 289/568] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:49 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 1335 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:49.372429 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:49.380000 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1cd72fa4-44b9-495b-9c3d-9abcb494f782 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1550 microversion: 2.1 time: 0.155453 Aug 04 02:21:49.380572 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 280/569] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:49 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:21:49.400441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:49.400985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:49.407326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.408291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.409093 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.409534 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.457348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:49.457950 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:49.464095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.464539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.465577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:49.466004 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:49.489056 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4dbc4b07-8b79-48b2-a9e3-aabfab8358c3 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092844 Aug 04 02:21:49.489646 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 290/570] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:21:49 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:49.599446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:49.607063 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-28970ba1-dc46-4e78-b94c-54e5284d9e4d tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.153532 Aug 04 02:21:49.607642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 281/571] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:49 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:21:50.274505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:50.275171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: e49839e3-fa7e-4a6c-bc4b-fb2162a73f42] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:50.281591 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.282067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.283351 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.283793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.299186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] HTTP exception thrown: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Request method failure captured: Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 HTTP/1.1 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6yweJha8d3a0mRMLSWAtIPTmKmHv92QHQX1BsRhZrds99PV_C6ccb2hgsW7KnQ_6l93EBj2t803gJRcDqaPaI1SB9hvxYEgnV8ZjQjHMAiwHILZJHXM9gZrkZRpApCBEctc26JOwkpbOjfJzTfEIIvIWsOLAM0GUBv6empfTLbSaSf0 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:21:50.300880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 033f13b2943945d3abc4ff852b68d698 Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. Aug 04 02:21:50.302453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'e49839e3-fa7e-4a6c-bc4b-fb2162a73f42'} Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:50.303279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. Aug 04 02:21:50.304432 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:50.305524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Returning 404 to user: Instance e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:50.305524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-78dc2857-448b-4657-8151-ec0958e41c1e tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42" status: 404 len: 111 microversion: 2.1 time: 0.032279 Aug 04 02:21:50.305524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 291/572] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:50 2022] GET /compute/v2.1/servers/e49839e3-fa7e-4a6c-bc4b-fb2162a73f42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:21:50.311430 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-81ba1eeb-b78f-43e0-b1cf-0ceb424849d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '.version_select at 0x7ff48f772280>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:50.332974 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-81ba1eeb-b78f-43e0-b1cf-0ceb424849d4 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-775170040" status: 202 len: 0 microversion: 2.1 time: 0.025134 Aug 04 02:21:50.337082 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 282/573] 10.222.0.45 () {58 vars in 1218 bytes} [Thu Aug 4 02:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-775170040 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:50.627770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:50.628739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:50.631833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:50.636536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.637011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.637796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.638484 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.738616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-a61de16d-911b-4e4a-acfc-7589b3b8d2b9 req-715d01f1-05d6-4ff1-a50d-f71b730bc66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa887f75-631c-4fb1-bd20-1dc970e29f0c", "tag": "7a967bf2-982f-49f8-91e4-16df519c5536"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:50.748447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a61de16d-911b-4e4a-acfc-7589b3b8d2b9 req-715d01f1-05d6-4ff1-a50d-f71b730bc66a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.749051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a61de16d-911b-4e4a-acfc-7589b3b8d2b9 req-715d01f1-05d6-4ff1-a50d-f71b730bc66a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.764977 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-a61de16d-911b-4e4a-acfc-7589b3b8d2b9 req-715d01f1-05d6-4ff1-a50d-f71b730bc66a service nova] Creating event network-changed:7a967bf2-982f-49f8-91e4-16df519c5536 for instance fa887f75-631c-4fb1-bd20-1dc970e29f0c on hv-cinder-74014 Aug 04 02:21:50.771073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-a61de16d-911b-4e4a-acfc-7589b3b8d2b9 req-715d01f1-05d6-4ff1-a50d-f71b730bc66a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036960 Aug 04 02:21:50.771863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 283/574] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:50.850190 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:50.859880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7746ec3f-7bb3-4ec5-a96b-283eceb45215 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1575 microversion: 2.1 time: 0.236387 Aug 04 02:21:50.861379 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 292/575] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:50 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:50.902670 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1bfa52-a127-4fed-a030-b303d9812ac2"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:50.905091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:50.913067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.913761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:50.914751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:50.915367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.004808 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: POST /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments HTTP/1.1 Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 74 Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:21:51.006994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {"volumeAttachment": {"volumeId": "1c1bfa52-a127-4fed-a030-b303d9812ac2"}} Aug 04 02:21:51.008434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'server_id': 'b2ea8a47-0d01-4e68-95e5-31a9977ac13f', 'body': {'volumeAttachment': {'volumeId': '1c1bfa52-a127-4fed-a030-b303d9812ac2'}}} Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:51.009331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:51.010678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:51.012056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:51.012056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:51.012056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:51.012056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f Aug 04 02:21:51.012056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:51.013205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 400 to user: Invalid volume: volume 1c1bfa52-a127-4fed-a030-b303d9812ac2 is already attached to instances: b2ea8a47-0d01-4e68-95e5-31a9977ac13f {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:51.014220 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ad4c6841-9abc-4622-ad65-6339bcc143a5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115952 Aug 04 02:21:51.018154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 284/576] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:21:50 2022] POST /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:21:51.093225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:51.094137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:51.104403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.104959 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.105809 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.106243 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.244221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lazy-loading 'services' on Instance uuid b2ea8a47-0d01-4e68-95e5-31a9977ac13f {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:51.364788 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-633227b1-59b0-4d7f-a5cb-9f94c2eb4d52 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments/1c1bfa52-a127-4fed-a030-b303d9812ac2" status: 202 len: 0 microversion: 2.1 time: 0.276244 Aug 04 02:21:51.365558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 293/577] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:21:51 2022] DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments/1c1bfa52-a127-4fed-a030-b303d9812ac2 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:51.378869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:51.381280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:51.390878 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.391528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.393413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.394008 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.428324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5122de63-4f7a-4e64-bd5f-bd4b38bc2f66 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055077 Aug 04 02:21:51.429701 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 285/578] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:21:51 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:21:51.883034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:51.883732 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:51.890530 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.890980 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:51.891927 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:51.892917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.117957 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:52.128447 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-172f1250-7553-46dc-99c2-4f51c5bce6a8 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1562 microversion: 2.1 time: 0.249753 Aug 04 02:21:52.130458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 294/579] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:51 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:52.442314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:52.444441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:52.451054 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.451513 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.452300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.452773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.459893 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:52.487669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4b0ebc11-7091-40ef-a17c-54cba02c7b41 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049781 Aug 04 02:21:52.488243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 286/580] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:21:52 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:21:52.556157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:52.556749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:52.563245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.563692 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.565049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.565544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.590812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:21:52.671986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2a029de6-15a4-4f08-b89b-4ff4f12ebc0d tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 204 len: 0 microversion: 2.1 time: 0.119069 Aug 04 02:21:52.676515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 295/581] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:21:52 2022] DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:21:52.682990 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:52.683945 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:52.690473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.690936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.691716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:52.692145 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:52.824952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:52.832436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0e2e104f-d70f-44b9-8fc3-d65c15a36316 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1680 microversion: 2.1 time: 0.154216 Aug 04 02:21:52.833032 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 287/582] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:52 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:53.365000 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-da1a923e-59a8-4a6d-a44e-79f7ebe7eb25 req-74ffc5f1-1788-48dd-8e08-09856e469d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "name": "network-vif-plugged", "status": "completed", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:53.374443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-da1a923e-59a8-4a6d-a44e-79f7ebe7eb25 req-74ffc5f1-1788-48dd-8e08-09856e469d67 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.374890 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-da1a923e-59a8-4a6d-a44e-79f7ebe7eb25 req-74ffc5f1-1788-48dd-8e08-09856e469d67 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.386197 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-da1a923e-59a8-4a6d-a44e-79f7ebe7eb25 req-74ffc5f1-1788-48dd-8e08-09856e469d67 service nova] Creating event network-vif-plugged:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:21:53.390950 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-da1a923e-59a8-4a6d-a44e-79f7ebe7eb25 req-74ffc5f1-1788-48dd-8e08-09856e469d67 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Aug 04 02:21:53.391555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 296/583] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:53.542565 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:53.543058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:53.549395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.549870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.550890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.551658 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.581020 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:21:53.655137 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0be01f75-b5ce-44bc-a0fa-a2fac9e63cb2 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 204 len: 0 microversion: 2.1 time: 0.116070 Aug 04 02:21:53.655724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 288/584] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:21:53 2022] DELETE /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:21:53.666842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:53.667542 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:53.673930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.674487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.675256 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.675694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.693707 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:53.805541 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:53.813023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-903db494-e13d-4059-9872-ea1f9fa95051 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1508 microversion: 2.1 time: 0.151605 Aug 04 02:21:53.813597 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 297/585] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:53 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:53.853610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:53.854301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:53.860460 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.860953 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:53.861752 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:53.862190 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:54.178526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:54.186478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-663aa417-3920-4f78-b5db-3b9d28885cfe tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1680 microversion: 2.1 time: 0.337022 Aug 04 02:21:54.187050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 289/586] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:53 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1680 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:54.834041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:54.834675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:54.841408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:54.841852 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:54.842605 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:54.843035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:55.026054 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:55.033522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5b07e069-3237-42c6-b4db-50b71fdb53cd tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1508 microversion: 2.1 time: 0.203418 Aug 04 02:21:55.034094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 298/587] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:54 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:55.208145 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:55.208709 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:55.215186 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:55.215632 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:55.216465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:55.216955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:55.353077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:55.360588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-dab34b0a-3db9-4716-836f-8d9d1cca29d1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1680 microversion: 2.1 time: 0.157011 Aug 04 02:21:55.361198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 290/588] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:55 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:56.055502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:56.056034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:56.062637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:56.063086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:56.063852 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:56.064291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:56.193042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:56.200464 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-64e50e06-153f-49c7-9afc-4321fe931e5b tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1508 microversion: 2.1 time: 0.149510 Aug 04 02:21:56.201071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 299/589] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:56 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:56.381853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:56.382454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:56.384841 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:21:56.393413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:56.393853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:56.394821 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:56.395292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:56.828400 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-342abe2a-d3c2-4ba9-abb4-39c9bc326111 req-8fc92134-7a7e-484b-8e68-d7a679015c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f941a4-8d6b-4c53-816d-e422f7e2a1f3", "name": "network-vif-deleted", "tag": "c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:56.840733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-342abe2a-d3c2-4ba9-abb4-39c9bc326111 req-8fc92134-7a7e-484b-8e68-d7a679015c77 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:56.841442 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-342abe2a-d3c2-4ba9-abb4-39c9bc326111 req-8fc92134-7a7e-484b-8e68-d7a679015c77 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:56.855689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-342abe2a-d3c2-4ba9-abb4-39c9bc326111 req-8fc92134-7a7e-484b-8e68-d7a679015c77 service nova] Creating event network-vif-deleted:c6ab1267-b3a9-4693-b0e1-d32a6bbc1f27 for instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 on hv-cinder-74014 Aug 04 02:21:56.861863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-342abe2a-d3c2-4ba9-abb4-39c9bc326111 req-8fc92134-7a7e-484b-8e68-d7a679015c77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039768 Aug 04 02:21:56.862536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 300/590] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:56.878390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:56.890609 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-315a1784-516a-4aa0-a14b-937b96f1ac57 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1680 microversion: 2.1 time: 0.511696 Aug 04 02:21:56.891914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 291/591] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:56 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1680 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:57.223575 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:57.225051 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:57.232923 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.233767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.234698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.235331 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.276465 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.276992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.277563 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lazy-loading 'fault' on Instance uuid 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:57.327092 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:57.337809 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8e78bf79-97bd-46fa-bff1-213696f5eb12 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 200 len: 1311 microversion: 2.1 time: 0.120073 Aug 04 02:21:57.338758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 301/592] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:57 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:57.491823 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-83b8bebc-db44-4c92-8652-2d93835767b5 req-c94d74aa-7dfa-448c-a4ca-46d33630937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ea8a47-0d01-4e68-95e5-31a9977ac13f", "name": "network-vif-deleted", "tag": "366e87a4-8a21-4561-abb7-e0a8211d1d43"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:57.501804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-83b8bebc-db44-4c92-8652-2d93835767b5 req-c94d74aa-7dfa-448c-a4ca-46d33630937d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.502295 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-83b8bebc-db44-4c92-8652-2d93835767b5 req-c94d74aa-7dfa-448c-a4ca-46d33630937d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.517820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-83b8bebc-db44-4c92-8652-2d93835767b5 req-c94d74aa-7dfa-448c-a4ca-46d33630937d service nova] Creating event network-vif-deleted:366e87a4-8a21-4561-abb7-e0a8211d1d43 for instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f on hv-cinder-74014 Aug 04 02:21:57.523591 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-83b8bebc-db44-4c92-8652-2d93835767b5 req-c94d74aa-7dfa-448c-a4ca-46d33630937d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036125 Aug 04 02:21:57.524887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 292/593] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:21:57.912523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:57.913834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:57.922721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.923508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.924583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.925193 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.966250 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:57.966697 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:57.967159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lazy-loading 'fault' on Instance uuid b2ea8a47-0d01-4e68-95e5-31a9977ac13f {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:21:58.017556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:58.026911 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-de122a25-df39-4074-b2b4-f768bc33569f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 200 len: 1332 microversion: 2.1 time: 0.118990 Aug 04 02:21:58.032778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 302/594] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:57 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:58.359844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:58.360538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: 25f941a4-8d6b-4c53-816d-e422f7e2a1f3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:58.367198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.367654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.368439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.368961 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.383678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] HTTP exception thrown: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Request method failure captured: Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 HTTP/1.1 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6yweJha8d3a0mRMLSWAtIPTmKmHv92QHQX1BsRhZrds99PV_C6ccb2hgsW7KnQ_6l93EBj2t803gJRcDqaPaI1SB9hvxYEgnV8ZjQjHMAiwHILZJHXM9gZrkZRpApCBEctc26JOwkpbOjfJzTfEIIvIWsOLAM0GUBv6empfTLbSaSf0 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:21:58.385465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 033f13b2943945d3abc4ff852b68d698 Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. Aug 04 02:21:58.386958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '25f941a4-8d6b-4c53-816d-e422f7e2a1f3'} Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:58.387728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. Aug 04 02:21:58.389125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:21:58.390223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Returning 404 to user: Instance 25f941a4-8d6b-4c53-816d-e422f7e2a1f3 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:58.390223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-47a89033-9267-49a1-a2e0-8d3d362b40be tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3" status: 404 len: 111 microversion: 2.1 time: 0.031331 Aug 04 02:21:58.390223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 293/595] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:58 2022] GET /compute/v2.1/servers/25f941a4-8d6b-4c53-816d-e422f7e2a1f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:21:58.396730 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:58.397223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:58.404721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.405131 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.405899 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.406332 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.431836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:21:58.509541 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cfc6d598-c02d-4850-8d6f-dadaca80f30c tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 204 len: 0 microversion: 2.1 time: 0.117230 Aug 04 02:21:58.510232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 303/596] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:21:58 2022] DELETE /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:21:58.518629 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:58.519356 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:58.526922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.527938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.528855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:58.529577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:58.667086 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:58.674517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-917031e5-2dc5-4f52-aaf6-f9c57129a374 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.159975 Aug 04 02:21:58.675068 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 294/597] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:58 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:21:59.050325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:59.051023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:59.057667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:59.058141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:59.058897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:59.059336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:59.072460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f HTTP/1.1 Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:21:59.074099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:21:59.075658 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'b2ea8a47-0d01-4e68-95e5-31a9977ac13f'} Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:21:59.076498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:21:59.077962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:21:59.079311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:21:59.079311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ff96e95d-d6ba-4b86-8dfb-9bf73b1c7131 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 404 len: 111 microversion: 2.1 time: 0.029413 Aug 04 02:21:59.079311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 304/598] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:59 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:21:59.084461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2e73c44b-db36-497d-8ca1-32bb73ade47a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '.version_select at 0x7ff48f7724c0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:59.104920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2e73c44b-db36-497d-8ca1-32bb73ade47a tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607500742" status: 202 len: 0 microversion: 2.1 time: 0.024216 Aug 04 02:21:59.105501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 295/599] 10.222.0.45 () {58 vars in 1221 bytes} [Thu Aug 4 02:21:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607500742 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:21:59.695796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:21:59.696414 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:21:59.702727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:59.703181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:59.703949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:21:59.704386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:21:59.713626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bb85c3e3-b8de-42fe-ac80-d31fcf5b54a0 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: .version_select at 0x7ff48f759280>, body: {"keypair": {"name": "tempest-keypair-1435557967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMrc554/ZDHcLO1SFkCKztPy6djV4F/myct19dxoqXTHqZXRoq8BjnJXZ1NrfwSMQ+3BTo9TFRICDp7fxQEhsziu1t0FIWzouPK2uL5XmN50smIeCgdeLT4+oQJ3t/gJQ=="}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:21:59.736156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-bb85c3e3-b8de-42fe-ac80-d31fcf5b54a0 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:21:59.741502 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-bb85c3e3-b8de-42fe-ac80-d31fcf5b54a0 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'key_pairs'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:21:59.766587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bb85c3e3-b8de-42fe-ac80-d31fcf5b54a0 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057134 Aug 04 02:21:59.767505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 296/600] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:21:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:21:59.854248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:21:59.862962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-869a9d0c-8110-4874-82d9-e5ca719b342f tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.171429 Aug 04 02:21:59.863568 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 305/601] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:21:59 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:00.883777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:00.884407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:00.891319 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:00.891775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:00.892849 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:00.893293 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:01.071810 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:01.074842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1485583108", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3fd5976-8837-4886-aaff-706d72d2761f"}], "security_groups": [{"name": "tempest-securitygroup--726144603"}], "key_name": "tempest-keypair-1435557967", "user_data": "}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:01.080130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bf58d4ea-8a91-462f-8456-65866ad29998 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.200636 Aug 04 02:22:01.080723 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 297/602] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:00 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:01.178583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] validate_networks() for [('c3fd5976-8837-4886-aaff-706d72d2761f', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:22:01.556634 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:22:01.557111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:22:01.557566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:22:01.557975 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:22:01.558387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:22:01.567295 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:01.568364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:01.569202 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:01.569641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:01.589366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:22:01.593551 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Getting quotas for user 76703dc82dc644ef8d32f7e259ddea6f and project 2f003cc2b7104c369e1aa74d6e48a9fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:22:01.604450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:22:01.606741 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:22:01.653612 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-00c22f23-9952-4697-a575-57d8ca2215bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.583422 Aug 04 02:22:01.654451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 306/603] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:22:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 02:22:01.665534 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4a71c176-b051-412d-8dce-7750381d192b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:01.666243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4a71c176-b051-412d-8dce-7750381d192b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:01.724078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4a71c176-b051-412d-8dce-7750381d192b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:01.730859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4a71c176-b051-412d-8dce-7750381d192b tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1242 microversion: 2.1 time: 0.069561 Aug 04 02:22:01.731456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 298/604] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:01 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:02.102524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:02.103918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:02.111516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.112225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.113221 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.113878 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.154589 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:02.155328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:02.162913 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.163339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.164195 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.164739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.191198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-84d9f4e7-f3e2-42f2-b8ce-949cdc115661 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/ips" status: 200 len: 152 microversion: 2.20 time: 0.041902 Aug 04 02:22:02.191898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 299/605] 10.222.0.45 () {60 vars in 1289 bytes} [Thu Aug 4 02:22:02 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:02.322493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033f13b2943945d3abc4ff852b68d698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d4ea2b52c497caeb298fe8677488e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:02.330407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fd415207-b180-4d6e-9c0e-6830926a2cee tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 200 len: 1521 microversion: 2.1 time: 0.232441 Aug 04 02:22:02.331102 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 307/606] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:02 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:02.517036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-d0c55452-a167-48e4-b71e-b6714cd9e2e6 req-60e4742b-0936-4f0d-a245-e1c456d30780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a319988c-e250-4b92-a587-cc65e764dd56", "name": "network-vif-deleted", "tag": "fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:02.533621 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d0c55452-a167-48e4-b71e-b6714cd9e2e6 req-60e4742b-0936-4f0d-a245-e1c456d30780 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.534091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d0c55452-a167-48e4-b71e-b6714cd9e2e6 req-60e4742b-0936-4f0d-a245-e1c456d30780 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.549181 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-d0c55452-a167-48e4-b71e-b6714cd9e2e6 req-60e4742b-0936-4f0d-a245-e1c456d30780 service nova] Creating event network-vif-deleted:fa4cef10-9b38-4ec0-b2aa-72cf2f3f793e for instance a319988c-e250-4b92-a587-cc65e764dd56 on hv-cinder-74014 Aug 04 02:22:02.570534 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-d0c55452-a167-48e4-b71e-b6714cd9e2e6 req-60e4742b-0936-4f0d-a245-e1c456d30780 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056925 Aug 04 02:22:02.571133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 300/607] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:02.752153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:02.753053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:02.760033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.760396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.761196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:02.761632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:02.837473 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:02.845758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cd964f7e-6647-41d0-8ec5-40a94f77cd61 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1312 microversion: 2.1 time: 0.097861 Aug 04 02:22:02.846423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:02 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:03.352683 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:03.353991 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] [instance: a319988c-e250-4b92-a587-cc65e764dd56] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:03.360273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:03.360768 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:03.361545 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:03.361986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:03.376311 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] HTTP exception thrown: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Request method failure captured: Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 HTTP/1.1 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6yweJha8d3a0mRMLSWAtIPTmKmHv92QHQX1BsRhZrds99PV_C6ccb2hgsW7KnQ_6l93EBj2t803gJRcDqaPaI1SB9hvxYEgnV8ZjQjHMAiwHILZJHXM9gZrkZRpApCBEctc26JOwkpbOjfJzTfEIIvIWsOLAM0GUBv6empfTLbSaSf0 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:22:03.378003 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c61d4ea2b52c497caeb298fe8677488e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: c61d4ea2b52c497caeb298fe8677488e Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-336781260 Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 033f13b2943945d3abc4ff852b68d698 Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-336781260-project Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. Aug 04 02:22:03.379454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'a319988c-e250-4b92-a587-cc65e764dd56'} Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:22:03.380944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. Aug 04 02:22:03.382540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:22:03.383682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] Returning 404 to user: Instance a319988c-e250-4b92-a587-cc65e764dd56 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:22:03.383682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9c696f17-646e-4082-8198-8469670d6bd8 tempest-ServerRescueNegativeTestJSON-336781260 tempest-ServerRescueNegativeTestJSON-336781260-project] 10.222.0.45 "GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56" status: 404 len: 111 microversion: 2.1 time: 0.031028 Aug 04 02:22:03.383682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 301/609] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:03 2022] GET /compute/v2.1/servers/a319988c-e250-4b92-a587-cc65e764dd56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:22:03.868631 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:03.869522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:03.890126 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:03.890854 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:03.891714 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:03.892145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.279367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:04.280602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:04.287432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:04.288225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.289229 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:04.289665 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.300974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:04.311154 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f4bc4b55-c9b7-4aae-a1c6-e4b03ad9677c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.447999 Aug 04 02:22:04.311774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 309/610] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:03 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:04.328367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lazy-loading 'flavor' on Instance uuid 54da993a-75f6-4244-8ed1-2bf6bab0917b {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:22:04.550169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-18c51df8-2e25-44ee-acdf-b0b54f2e7222 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/action" status: 202 len: 0 microversion: 2.20 time: 0.276455 Aug 04 02:22:04.555943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 302/611] 10.222.0.45 () {62 vars in 1319 bytes} [Thu Aug 4 02:22:04 2022] POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:04.560789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:04.561782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:04.571512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:04.572574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.573757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:04.574208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.773767 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-e5b2b0ed-0de0-47f6-af53-eec2240160d2 req-80299604-23a3-49db-b8d4-a446b008eee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54afe06e-392b-455f-93ac-4e6471433b8b", "tag": "06fdec2e-918d-4e19-b051-7f47fc105a20"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:04.789275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-e5b2b0ed-0de0-47f6-af53-eec2240160d2 req-80299604-23a3-49db-b8d4-a446b008eee0 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:04.790091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-e5b2b0ed-0de0-47f6-af53-eec2240160d2 req-80299604-23a3-49db-b8d4-a446b008eee0 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:04.808095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-e5b2b0ed-0de0-47f6-af53-eec2240160d2 req-80299604-23a3-49db-b8d4-a446b008eee0 service nova] Creating event network-changed:06fdec2e-918d-4e19-b051-7f47fc105a20 for instance 54afe06e-392b-455f-93ac-4e6471433b8b on hv-cinder-74014 Aug 04 02:22:04.813324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-e5b2b0ed-0de0-47f6-af53-eec2240160d2 req-80299604-23a3-49db-b8d4-a446b008eee0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043573 Aug 04 02:22:04.814192 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 303/612] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:04.819666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:04.828132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:04.829806 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:04.831085 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2ea325de-51e8-4ba1-8fb3-46135a3d6020 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.274472 Aug 04 02:22:04.833574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 310/613] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:04 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:05.332808 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:05.333826 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:05.340985 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:05.341692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:05.342640 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:05.343240 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:05.547579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:05.557131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6b6d2ec1-9f71-441b-aa00-4be89cbed495 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.228497 Aug 04 02:22:05.557852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 304/614] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:05 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:05.854470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:05.855075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:05.861814 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:05.862492 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:05.863272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:05.863728 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:06.062338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:06.075997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:06.080566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:06.082490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-766359aa-80b0-4880-a1cc-c1a13543e5fe tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.231900 Aug 04 02:22:06.084174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 311/615] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:05 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:06.582887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:06.584142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:06.594711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:06.595156 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:06.598710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:06.599476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:06.841983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:06.849921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.854841 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fd491665-deb1-4f59-ab84-6de15be6122f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.279721 Aug 04 02:22:06.855420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 305/616] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:06 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:07.110130 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:07.110737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:07.117514 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:07.117963 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:07.118737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:07.119178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:07.364900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:07.377025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:07.378717 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:07.380528 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-57372dc2-e744-453d-a4db-a525b1a6a861 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.273942 Aug 04 02:22:07.381400 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 312/617] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:07 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:07.879258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:07.879962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:07.898098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:07.898847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:07.900106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:07.900797 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:08.069130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:08.076874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4913980f-fd3a-4a4e-aa49-449d5c788cb8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.204643 Aug 04 02:22:08.077476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 306/618] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:07 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:08.404362 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:08.405019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:08.412053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:08.412504 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:08.413311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:08.413747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:08.554726 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:08.558319 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:08.564049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:08.565646 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:08.566841 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8c81fb0d-8692-4b97-8149-f030c6ae59f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.167098 Aug 04 02:22:08.567409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 313/619] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:08 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:09.100839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:09.101484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:09.107680 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:09.108134 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:09.108944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:09.109383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:09.245021 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:09.252410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e4189f1e-9767-4081-a965-92690149f6e5 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.156125 Aug 04 02:22:09.252945 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 307/620] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:09 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:09.590077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:09.590954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:09.598138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:09.599094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:09.600064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:09.600499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:09.746858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:09.755834 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:09.757514 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:09.758721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6bb500d7-0b43-4a8d-8019-6d5058ca0531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.173445 Aug 04 02:22:09.760960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 314/621] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:09 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:10.273608 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:10.274242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:10.282463 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:10.282979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:10.283827 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:10.284386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:10.438392 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:10.446592 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f476b72e-a0f1-4a80-8d53-ee1ee2f6038f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.177089 Aug 04 02:22:10.447350 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 308/622] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:10 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:10.782988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:10.783552 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:10.790700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:10.791227 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:10.792189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:10.792649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:10.945523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:10.953786 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:10.955277 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:10.956433 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6e55dcdd-2670-4f57-831b-875f1333683a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.177474 Aug 04 02:22:10.957041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 315/623] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:10 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:11.464282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-8923a422-82c9-4c82-965f-aaac843a2903 req-4947724e-1534-4f80-b7c2-3c9e5e7c84d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54afe06e-392b-455f-93ac-4e6471433b8b", "name": "network-vif-plugged", "status": "completed", "tag": "06fdec2e-918d-4e19-b051-7f47fc105a20"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:11.471146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:11.472285 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:11.477919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-8923a422-82c9-4c82-965f-aaac843a2903 req-4947724e-1534-4f80-b7c2-3c9e5e7c84d4 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:11.478680 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-8923a422-82c9-4c82-965f-aaac843a2903 req-4947724e-1534-4f80-b7c2-3c9e5e7c84d4 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:11.484960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:11.485813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:11.486745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:11.489348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:11.494005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-8923a422-82c9-4c82-965f-aaac843a2903 req-4947724e-1534-4f80-b7c2-3c9e5e7c84d4 service nova] Creating event network-vif-plugged:06fdec2e-918d-4e19-b051-7f47fc105a20 for instance 54afe06e-392b-455f-93ac-4e6471433b8b on hv-cinder-74014 Aug 04 02:22:11.499966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-8923a422-82c9-4c82-965f-aaac843a2903 req-4947724e-1534-4f80-b7c2-3c9e5e7c84d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039586 Aug 04 02:22:11.501732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 309/624] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:11.578642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:11.600590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:11.675527 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:11.690781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc907414-1a6b-4ea2-a5de-5c4dd8176489 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.226815 Aug 04 02:22:11.691370 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 316/625] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:11 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:11.976467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:11.985127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:11.985969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:11.993370 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:11.993822 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:11.994596 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:11.995205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:12.133817 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:12.142424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:12.143936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:12.145476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a0d88cb5-95a4-4455-9410-b4bbb2ad49f0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.169914 Aug 04 02:22:12.146516 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 310/626] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:11 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:12.722879 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:12.723418 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:12.730423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:12.730874 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:12.731647 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:12.732086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:12.865417 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:12.872868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d73e867e-7901-4f2e-865b-104ceb76b071 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1367 microversion: 2.1 time: 0.153842 Aug 04 02:22:12.873434 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 317/627] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:12 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:13.168433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:13.169205 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:13.176409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:13.176409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:13.176610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:13.177025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:13.309723 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:13.318191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:13.319703 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:13.320925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3a96c6d0-89ab-45df-ac4b-773c3c8ebd6e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.156301 Aug 04 02:22:13.321482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 311/628] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:13 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:13.894087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:13.894745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:13.901408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:13.901855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:13.902735 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:13.903895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:14.155216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:14.163749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0c1aaea3-cd37-461e-830c-7067cc3dbd35 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1558 microversion: 2.1 time: 0.273754 Aug 04 02:22:14.164326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 318/629] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:22:13 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:14.184400 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:14.184928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:14.191016 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:14.191541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:14.192863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:14.193317 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:14.269584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8b80e737-5a63-4306-a256-d25cd1274d7f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089262 Aug 04 02:22:14.270395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 312/630] 10.222.0.45 () {58 vars in 1275 bytes} [Thu Aug 4 02:22:14 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:14.623938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:14.624674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:14.631572 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:14.632113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:14.632992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:14.633648 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:14.787044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:14.796104 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:14.797739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:14.799216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1f9edd1b-8e3b-48e3-a0b8-1b3320a86c3c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.459723 Aug 04 02:22:14.813100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 319/631] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:14 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:15.304766 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-d86d23e1-84d4-4ea6-b4a9-d3d1df465478 req-3fe414d3-2b7b-4493-8b6d-6f9424d9db10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54afe06e-392b-455f-93ac-4e6471433b8b", "tag": "06fdec2e-918d-4e19-b051-7f47fc105a20"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:15.315035 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d86d23e1-84d4-4ea6-b4a9-d3d1df465478 req-3fe414d3-2b7b-4493-8b6d-6f9424d9db10 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:15.315470 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d86d23e1-84d4-4ea6-b4a9-d3d1df465478 req-3fe414d3-2b7b-4493-8b6d-6f9424d9db10 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:15.329442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-d86d23e1-84d4-4ea6-b4a9-d3d1df465478 req-3fe414d3-2b7b-4493-8b6d-6f9424d9db10 service nova] Creating event network-changed:06fdec2e-918d-4e19-b051-7f47fc105a20 for instance 54afe06e-392b-455f-93ac-4e6471433b8b on hv-cinder-74014 Aug 04 02:22:15.338827 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-d86d23e1-84d4-4ea6-b4a9-d3d1df465478 req-3fe414d3-2b7b-4493-8b6d-6f9424d9db10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038179 Aug 04 02:22:15.339786 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 313/632] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:15.826964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:15.828199 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:15.838444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:15.839699 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:15.841967 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:15.844234 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:16.292326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:16.300886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:16.302723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:16.303905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-21938a2f-5e80-4965-81ed-38759fbcf8dc tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.484804 Aug 04 02:22:16.304846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 320/633] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:15 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:17.328197 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:17.328898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:17.336916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:17.337556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:17.338497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:17.338941 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:17.470623 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:17.479019 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:17.480502 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:17.481679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-380646c2-f4da-428b-9b7b-a43ce5137699 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.158006 Aug 04 02:22:17.482228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 314/634] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:17 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:18.503200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:18.503811 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:18.510246 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:18.510700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:18.511472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:18.512026 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:18.692420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:18.701627 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:18.703150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:18.704324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7d322541-2811-4c00-aac7-9c8b592e213c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.204950 Aug 04 02:22:18.705198 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 321/635] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:18 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:19.727079 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:19.727728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:19.733950 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:19.734405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:19.735178 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:19.735623 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:19.873005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:19.881952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:19.883573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:19.884839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7ac55e53-e667-4633-b98c-7d40eff975d3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.161534 Aug 04 02:22:19.885485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 315/636] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:19 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:20.907263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:20.907930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:20.910239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.917301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:20.917758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:20.918635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:20.919879 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:21.056493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:21.064441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:21.065978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:21.067132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-eab7c000-74f1-4766-b68d-ebca5e8c5eab tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1745 microversion: 2.20 time: 0.163729 Aug 04 02:22:21.067690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 322/637] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:20 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:22.090461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:22.091315 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:22.098338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:22.098935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:22.099727 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:22.100170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:22.234369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:22.242237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:22.243776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:22.244964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b7264f16-2370-4a22-80db-e251158b55b2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1745 microversion: 2.20 time: 0.159062 Aug 04 02:22:22.245518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 316/638] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:22 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:23.271305 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:23.272653 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:23.285171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:23.288385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:23.289629 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:23.290516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:23.450696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:23.460279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:23.462191 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:23.463462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-68415ad4-f0ee-4b5b-859e-0f2babf9c19a tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.195972 Aug 04 02:22:23.464121 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 323/639] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:23 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:23.613958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-d608182b-a575-467a-9aed-5b700d339177 req-0d74b8cb-b525-4bbc-8c8e-faa961cffd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "name": "network-vif-plugged", "status": "completed", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:23.636116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d608182b-a575-467a-9aed-5b700d339177 req-0d74b8cb-b525-4bbc-8c8e-faa961cffd16 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:23.636753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-d608182b-a575-467a-9aed-5b700d339177 req-0d74b8cb-b525-4bbc-8c8e-faa961cffd16 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:23.657711 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-d608182b-a575-467a-9aed-5b700d339177 req-0d74b8cb-b525-4bbc-8c8e-faa961cffd16 service nova] Creating event network-vif-plugged:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:22:23.665549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-d608182b-a575-467a-9aed-5b700d339177 req-0d74b8cb-b525-4bbc-8c8e-faa961cffd16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054879 Aug 04 02:22:23.666760 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 317/640] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:22:24.492876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:24.493486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:24.501508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:24.502298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:24.503302 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:24.503928 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:24.661017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:24.671957 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:24.673782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:24.675322 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d98554f7-47cd-4fde-823a-349770ae25ec tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.186427 Aug 04 02:22:24.675882 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 324/641] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:24 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:25.699018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:25.699716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:25.706112 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:25.706570 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:25.707349 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:25.707791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:25.870922 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:25.879216 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:25.880732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:25.881882 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e5757bec-073a-4413-a2bb-31ebd4d1d960 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.187169 Aug 04 02:22:25.882612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 318/642] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:25 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:26.906448 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:26.907336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:26.920745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:26.921466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:26.922431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:26.922872 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:27.067046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:27.075855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:27.077704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:27.079138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9d77f238-1c67-48f9-af70-d6a2acff7810 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.176897 Aug 04 02:22:27.080118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 325/643] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:26 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:28.103044 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:28.103616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:28.105886 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.111515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:28.111962 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:28.112852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:28.113292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:28.263763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:28.272233 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:28.273932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:28.275115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ff31d333-d914-4d9c-96f5-5d496832848c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.176789 Aug 04 02:22:28.281043 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 319/644] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:28 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:29.298991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:29.299612 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:29.309643 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:29.310931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:29.312316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:29.313412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:29.496706 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:29.507574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:29.509159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:29.510876 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5c8a550e-2d1d-4d95-9c96-c671e34891fa tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.216309 Aug 04 02:22:29.511678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 326/645] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:29 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:30.533549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:30.534283 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:30.540862 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:30.541585 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:30.542595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:30.543235 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:30.732869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:30.745909 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:30.751869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:30.754127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-651e2e41-c38c-4ff8-91dc-1538f3db9f71 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.224118 Aug 04 02:22:30.768147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 320/646] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:30 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:31.778078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:31.778692 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:31.785618 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:31.786064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:31.786915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:31.787298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:31.917316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:31.927237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:31.928794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:31.929989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-25bdcf9a-6285-4670-acb4-adbe5e763cd1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1740 microversion: 2.20 time: 0.156260 Aug 04 02:22:31.930589 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 327/647] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:31 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:32.951412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:32.952254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:32.958366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:32.958810 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:32.959565 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:32.959996 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:33.097830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:33.109380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:33.110905 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:33.112072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bec84e87-ebcf-4eec-85eb-e9ba049e68d9 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1722 microversion: 2.20 time: 0.164578 Aug 04 02:22:33.112659 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 321/648] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:32 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:34.135163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:34.135824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:34.142361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:34.142812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:34.143580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:34.144028 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:34.270873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:34.279396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:34.280973 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:34.282147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b8860281-649d-413b-ac7e-c48680ca3381 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1722 microversion: 2.20 time: 0.151426 Aug 04 02:22:34.282705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 328/649] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:34 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:35.029661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:35.030203 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:35.038339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.038791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.039558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.039987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.065365 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c208b6ec-3543-48f0-bb90-8daaf53dc3c4 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/ips" status: 200 len: 145 microversion: 2.1 time: 0.220717 Aug 04 02:22:35.065997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 322/650] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:22:34 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/ips => generated 145 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:22:35.303640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:35.304224 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:35.311855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.312353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.313214 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.313664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.474251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:35.482472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:35.483984 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:35.485177 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0b8e5980-4c19-4adf-9be2-bb64090b3f94 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1725 microversion: 2.20 time: 0.185400 Aug 04 02:22:35.493228 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 329/651] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:35 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:35.507594 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9dca1d-c86a-4ea8-9588-b4140e599863"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:35.508960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-27c5b23f-9243-49c5-8ccf-484cfb0c6a60 req-3ab57bed-3ddb-4e4c-92b5-6f5313a9329b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "name": "network-vif-unplugged", "status": "completed", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:35.510741 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:35.517051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.517504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.518551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.518965 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.519553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-27c5b23f-9243-49c5-8ccf-484cfb0c6a60 req-3ab57bed-3ddb-4e4c-92b5-6f5313a9329b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.519984 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-27c5b23f-9243-49c5-8ccf-484cfb0c6a60 req-3ab57bed-3ddb-4e4c-92b5-6f5313a9329b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.533346 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.compute.server_external_events [req-27c5b23f-9243-49c5-8ccf-484cfb0c6a60 req-3ab57bed-3ddb-4e4c-92b5-6f5313a9329b service nova] Unable to find a host for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b. Dropping event network-vif-unplugged {{(pid=118168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 02:22:35.534235 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-27c5b23f-9243-49c5-8ccf-484cfb0c6a60 req-3ab57bed-3ddb-4e4c-92b5-6f5313a9329b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029145 Aug 04 02:22:35.534829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 330/652] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 02:22:35.711944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.794486 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f05e45e6-051e-480b-8f83-1299f5da0e02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290895 Aug 04 02:22:35.795117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 323/653] 10.222.0.45 () {62 vars in 1364 bytes} [Thu Aug 4 02:22:35 2022] POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:35.918164 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:35.918661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:35.924743 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.925196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.925962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:35.926437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:35.930512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.181630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-549b632a-7e2a-4c04-9ac2-2c2e5a23cd02 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments/eb9dca1d-c86a-4ea8-9588-b4140e599863" status: 202 len: 0 microversion: 2.20 time: 0.267878 Aug 04 02:22:36.182394 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 331/654] 10.222.0.45 () {60 vars in 1457 bytes} [Thu Aug 4 02:22:35 2022] DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments/eb9dca1d-c86a-4ea8-9588-b4140e599863 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:36.244056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:36.244860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:36.252708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.252708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.252708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.252989 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.281581 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118167) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 02:22:36.347311 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9b13cfb4-f8c7-4026-91ef-f196fb774bd3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/action" status: 202 len: 0 microversion: 2.20 time: 0.107182 Aug 04 02:22:36.348143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 324/655] 10.222.0.45 () {62 vars in 1319 bytes} [Thu Aug 4 02:22:36 2022] POST /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:36.356757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:36.356757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:36.367321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.368059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.369598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.370560 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.431583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b05fdff8-da88-4f37-b645-29384baac3d2"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:22:36.434369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:36.443097 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.443097 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.443664 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:36.444249 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:36.557793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:36.567450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:36.569500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:36.573352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6a363b41-2de0-4295-a217-27fda055f7c8 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1673 microversion: 2.20 time: 0.219713 Aug 04 02:22:36.589509 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 332/656] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:36 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:22:36.729140 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ae8c00e6-b818-4508-ba87-dcb545b5dc50 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301951 Aug 04 02:22:36.729757 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 325/657] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:22:36 2022] POST /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:22:37.598887 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:37.599595 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:37.607622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:37.608070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:37.608903 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:37.609339 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:37.852757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:37.861176 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:37.862673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:37.864175 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-253f2e8e-1104-4524-995a-6584156bbe0d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.270265 Aug 04 02:22:37.864774 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 333/658] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:37 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:38.889536 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:38.890247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:38.897573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:38.898033 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:38.898820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:38.899262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:39.083067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:39.092249 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:39.097119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:39.098341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ef827919-7b87-4ec4-bec8-67facb45af72 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.214817 Aug 04 02:22:39.098916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 326/659] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:38 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:40.122965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:40.123584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:40.131011 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:40.131558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:40.132518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:40.133937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:40.280444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:40.289009 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:40.291436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:40.292856 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-02b928a4-a7b8-4ced-a206-a65716ee272d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.174805 Aug 04 02:22:40.293450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 334/660] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:40 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:41.317652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:41.318174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:41.325539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:41.332978 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:41.334121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:41.334655 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:41.471129 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:41.481127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:41.483392 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:41.484605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fd77a5c1-852c-4321-b566-98fb11f3914f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.170897 Aug 04 02:22:41.485512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 327/661] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:41 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:42.509186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:42.509770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:42.516197 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:42.516654 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:42.517416 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:42.517847 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:42.664976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:42.674682 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:42.676183 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:42.677580 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d8960f70-1b5b-4c71-8382-21f37e437934 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.172071 Aug 04 02:22:42.678151 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 335/662] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:42 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:43.702591 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:43.703267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:43.709828 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:43.710574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:43.711438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:43.711829 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:43.866310 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:43.875114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:43.876659 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:43.877839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-977b7f99-1ed7-49aa-85c5-711e5c5321c6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.181282 Aug 04 02:22:43.878557 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 328/663] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:43 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:44.903118 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:44.904535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:44.911981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:44.912858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:44.913637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:44.914241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:45.053346 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:45.062236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:45.064031 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:45.065353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-40aa003f-2422-4897-94c8-e6a6ab3871c5 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.168494 Aug 04 02:22:45.065917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 336/664] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:44 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:46.088418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:46.089117 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:46.096047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:46.096499 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:46.097311 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:46.097753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:46.241448 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:46.250621 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:46.252127 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:46.253333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-485a4f19-c2fb-422e-9a6b-b7f9bddf98d0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.168864 Aug 04 02:22:46.263103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 329/665] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:46 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:47.275812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:47.276388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:47.282880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:47.283374 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:47.284104 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:47.284548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:47.415243 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:47.423643 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:47.425171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:47.426321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f14ed480-5720-4522-913e-77a3e1d38ea0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.154520 Aug 04 02:22:47.426883 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 337/666] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:47 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:48.449553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:48.450076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:48.457067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:48.457478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:48.458258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:48.458712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:48.606417 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:48.614332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:48.615839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:48.617120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f73f9127-25b5-402e-9d6a-e2b896491e07 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.172487 Aug 04 02:22:48.617684 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 330/667] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:48 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:49.639926 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:49.640486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:49.647525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:49.647979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:49.648790 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:49.649233 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:49.786664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:49.794362 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:49.795855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:49.797030 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-04cb32b6-e467-48a8-aa39-65654b3bb177 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.161606 Aug 04 02:22:49.797596 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 338/668] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:49 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:50.819737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:50.820337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:50.826749 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:50.827210 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:50.827942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:50.828369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:50.969263 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:50.977596 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:50.978774 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:50.979921 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bf1811f4-1fc5-4e44-ae66-a140de2754fb tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.164037 Aug 04 02:22:50.980699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 331/669] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:50 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:52.003217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:52.003841 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:52.006166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=34 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.011482 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:52.011924 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:52.012699 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:52.013128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:52.145526 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:52.154520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:52.156040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:52.157370 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1c59cc9a-753c-43a2-8a6f-bbce207cba21 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.157946 Aug 04 02:22:52.157886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 339/670] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:51 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:53.180524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:53.181180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:53.188259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:53.188737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:53.189497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:53.189923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:53.323366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:53.331294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:53.332843 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:53.333999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-172ba74b-5bdf-4690-8319-7c465a83205e tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.157472 Aug 04 02:22:53.334541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 332/671] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:53 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:54.357999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:54.358616 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:54.365187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:54.365642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:54.366409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:54.366848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:54.503836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:54.512439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:54.513970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:54.515138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0d8fc1f0-e267-44ac-a9ab-b7445dc2ce36 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.161142 Aug 04 02:22:54.515700 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 340/672] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:54 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:55.537781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:55.538391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:55.544949 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:55.545398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:55.546160 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:55.546593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:55.677837 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:55.685644 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:55.687146 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:55.688295 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f99a600d-dbf1-47a4-b7ad-45d70c8b6390 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.154471 Aug 04 02:22:55.688884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 333/673] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:55 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:56.159006 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:56.159573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:56.166880 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:56.168071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:56.168906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:56.169350 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:56.192325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0e88ced2-db78-45ed-9e29-d87a85cabfbb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037795 Aug 04 02:22:56.192939 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 341/674] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:22:56 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:22:56.711520 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:56.712122 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:56.718846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:56.719286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:56.720038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:56.720467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:56.846710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:56.854538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:56.856025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:56.857206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3d9a8c1a-7ad9-4cb4-bda3-2b6aa554c08c tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.149647 Aug 04 02:22:56.857762 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 334/675] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:56 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:57.879622 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:57.880263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:57.889895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:57.890359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:57.892252 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:57.892745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:58.023915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:58.032770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:58.034283 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:58.035443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a02b1239-8b4f-4c67-ab3c-5ab969a9b5f1 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.159922 Aug 04 02:22:58.036002 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 342/676] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:57 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:22:59.057476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:22:59.058088 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:22:59.060521 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.066098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:59.066480 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:59.067254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:22:59.067693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:22:59.207403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:59.216150 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:59.218025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:22:59.219185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-87247092-801b-4e90-8f3f-3867462916e7 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.165612 Aug 04 02:22:59.219737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 335/677] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:22:59 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:00.242196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:00.246067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:00.249629 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:00.250075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:00.250851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:00.251288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:00.384512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:00.393398 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:00.394878 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:00.396024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bf334aaa-62cf-49eb-bbeb-df12753b184d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.157867 Aug 04 02:23:00.396636 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 343/678] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:00 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:01.419353 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:01.419984 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:01.427488 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:01.428134 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:01.429137 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:01.429620 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:01.568128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:01.571675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.577584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:01.579051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:01.580226 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1b4491f3-c339-498d-929c-3dbe8eda2b8f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.165384 Aug 04 02:23:01.589839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 336/679] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:01 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:01.763122 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63f6059f-e44c-45df-b4e5-a22104bc1e39"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:01.766393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:01.773082 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:01.774101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:01.775096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:01.775751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.078696 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.098803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-94918d28-cee2-4684-9a91-b74401615a19 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "POST /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340272 Aug 04 02:23:02.099394 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 344/680] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:23:01 2022] POST /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:02.301321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:02.303548 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:02.310409 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.310874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.311616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.312045 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.341340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7789e591-7c62-4378-8dab-6c2e3f29f51e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 04 02:23:02.341885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 337/681] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:02 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:02.353841 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:02.354421 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:02.360649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.361117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.361889 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.362326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.393600 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-82328316-95dd-4d3c-9185-28d9cab6d7d7 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2" status: 200 len: 194 microversion: 2.1 time: 0.044509 Aug 04 02:23:02.394133 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 345/682] 10.222.0.45 () {58 vars in 1413 bytes} [Thu Aug 4 02:23:02 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:02.613100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:02.613793 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:02.620854 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.621825 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.622660 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:02.623099 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:02.763073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:02.771343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:02.772872 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:02.774027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-74aaebd3-533a-45d6-8721-0257097c11d4 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.165623 Aug 04 02:23:02.774589 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 338/683] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:02 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:03.746016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fecac6cf-373a-4f0c-80c7-00c5ccbcc220"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:03.748439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:03.754853 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:03.755306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:03.756060 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:03.756497 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:03.802137 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:03.802759 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:03.809328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:03.809777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:03.810738 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:03.811315 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:03.947262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:03.956801 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:03.958322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:03.959474 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3b498184-aec6-4547-b695-28fc9e215b27 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.166955 Aug 04 02:23:03.960037 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 339/684] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:03 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:23:04.008569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f40e5270-fc41-4103-a90f-f8a3808dc495 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "POST /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266302 Aug 04 02:23:04.009229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 346/685] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:23:03 2022] POST /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:04.983072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:04.983694 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:04.990172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:04.990617 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:04.991378 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:04.991812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:05.127238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:05.135234 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:05.136744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:05.138567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a987f1d2-6146-4137-b40f-e7b05d27fc97 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.159518 Aug 04 02:23:05.139113 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 340/686] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:04 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:06.161845 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:06.162648 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:06.169041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:06.169487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:06.170252 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:06.170689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:06.312726 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:06.321508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:06.323143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:06.324386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dfdaefde-66ee-4e83-9b3b-44a8409a4f1b tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.167227 Aug 04 02:23:06.325679 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 347/687] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:06 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:06.701174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-0d38426a-564f-42a3-ae91-ee5db7e71973 req-6192fc19-0ac2-45a8-b6f5-15491e7eeb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "name": "network-vif-plugged", "status": "completed", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:06.719196 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0d38426a-564f-42a3-ae91-ee5db7e71973 req-6192fc19-0ac2-45a8-b6f5-15491e7eeb15 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:06.719917 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0d38426a-564f-42a3-ae91-ee5db7e71973 req-6192fc19-0ac2-45a8-b6f5-15491e7eeb15 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:06.731952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-0d38426a-564f-42a3-ae91-ee5db7e71973 req-6192fc19-0ac2-45a8-b6f5-15491e7eeb15 service nova] Creating event network-vif-plugged:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:23:06.737094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-0d38426a-564f-42a3-ae91-ee5db7e71973 req-6192fc19-0ac2-45a8-b6f5-15491e7eeb15 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185649 Aug 04 02:23:06.737678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 341/688] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:07.349093 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:07.349750 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:07.356573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:07.357047 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:07.357877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:07.358303 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:07.508970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:07.516791 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:07.518288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:07.519442 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-93b9827c-762d-43d6-9c5c-0bbc03839b8d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.174441 Aug 04 02:23:07.519996 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 348/689] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:07 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:08.542904 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:08.544361 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:08.551194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:08.551762 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:08.552524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:08.553080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:08.701102 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:08.709211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:08.710693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:08.712058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-64fa8bbe-6e01-413f-a7b5-eb72b79dd563 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1731 microversion: 2.20 time: 0.173940 Aug 04 02:23:08.712652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 342/690] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:08 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:09.735531 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:09.736149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:09.737726 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:09.738224 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:09.742690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.743147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.743922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.744364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.744718 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.745176 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.745948 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.746426 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.829618 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lazy-loading 'services' on Instance uuid 54afe06e-392b-455f-93ac-4e6471433b8b {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:09.886914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:09.895586 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:09.897239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:09.898419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ba4736b8-f229-4b36-a8b2-b08b040bdfea tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1718 microversion: 2.20 time: 0.166835 Aug 04 02:23:09.898966 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 349/691] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:09 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:09.914047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-aa8145ec-f6e5-460e-8785-89e6e74465a6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments/63f6059f-e44c-45df-b4e5-a22104bc1e39" status: 202 len: 0 microversion: 2.1 time: 0.179808 Aug 04 02:23:09.916118 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 343/692] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:23:09 2022] DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments/63f6059f-e44c-45df-b4e5-a22104bc1e39 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:23:09.925962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:09.928280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:09.935107 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.935498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.936271 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:09.936737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:09.969125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f358c005-50a0-4406-8142-0e51c30d83a7 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Aug 04 02:23:09.973931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 350/693] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:09 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:10.982669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:10.984988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:10.991375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:10.991824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:10.992594 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:10.993056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:11.023288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ff42c55b-cd9f-461d-b28c-355b799fc22f tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 04 02:23:11.023866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 344/694] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:10 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:12.035456 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:12.037654 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:12.044686 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:12.045353 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:12.046128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:12.046569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:12.076261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-52a104cf-8d8c-4907-ba64-82670de088e1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 04 02:23:12.076759 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 351/695] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:12 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:13.087995 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:13.090174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:13.097066 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:13.097516 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:13.098278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:13.098712 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:13.126841 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-89ff605a-4bc3-4c29-b41d-d4c6e506fb58 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 Aug 04 02:23:13.127383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 345/696] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:13 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:14.138851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:14.141036 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:14.147547 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:14.147998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:14.148808 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:14.149245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:14.178059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8b547888-b946-4673-a3b8-fe57865b1068 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Aug 04 02:23:14.178617 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 352/697] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:14 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:15.191431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:15.193668 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:15.200171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.200642 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:15.201434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.201870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:15.230591 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3fd0cc07-861a-4bb4-9bcb-db52a97da4e8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Aug 04 02:23:15.231143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 346/698] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:15 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:15.777086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:15.779359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:15.786147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.786607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:15.787409 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.787971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:15.818459 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d49516bb-7069-449a-ae6a-3300ea607662 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045354 Aug 04 02:23:15.819023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 353/699] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:15 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:15.971183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:15.971678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:15.977977 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.978441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:15.979243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:15.979747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:16.020848 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4ad13cf4-7f1d-49d1-aaa0-71e81bc23bd9 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2" status: 200 len: 194 microversion: 2.1 time: 0.053957 Aug 04 02:23:16.021559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 347/700] 10.222.0.45 () {58 vars in 1413 bytes} [Thu Aug 4 02:23:15 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:16.031808 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:16.032300 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:16.038202 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:16.038646 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:16.039405 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:16.039840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:16.121843 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lazy-loading 'services' on Instance uuid fa887f75-631c-4fb1-bd20-1dc970e29f0c {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:16.195077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3fa24617-f7e5-4828-b1d1-48bdf8e964fa tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2" status: 202 len: 0 microversion: 2.1 time: 0.167069 Aug 04 02:23:16.195720 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 354/701] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:23:16 2022] DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/b05fdff8-da88-4f37-b645-29384baac3d2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:23:16.243442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:16.245657 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:16.252750 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:16.253211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:16.253993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:16.254440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:16.299752 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-51ed3d47-26fd-4561-9ac7-f0b2f16939d8 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060274 Aug 04 02:23:16.300845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 348/702] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:16 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:17.313585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:17.315934 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:17.322240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.322685 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.323460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.323872 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.334399 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:17.335082 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:17.341833 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.342280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.343318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.343751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.356664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aa33fe7d-b4e8-40d5-866c-18ad7a0ab6fc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048334 Aug 04 02:23:17.357536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 355/703] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:17 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:23:17.376173 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9bcf645b-6b17-4a76-8627-6de102c52e62 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/fecac6cf-373a-4f0c-80c7-00c5ccbcc220" status: 200 len: 194 microversion: 2.1 time: 0.045373 Aug 04 02:23:17.377006 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 349/704] 10.222.0.45 () {58 vars in 1413 bytes} [Thu Aug 4 02:23:17 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/fecac6cf-373a-4f0c-80c7-00c5ccbcc220 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:23:17.389615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:17.390228 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:17.396468 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.396953 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.397742 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.398194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.428310 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:17.428840 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:17.434986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.435295 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.436070 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.436505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.462606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:23:17.480209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lazy-loading 'services' on Instance uuid fa887f75-631c-4fb1-bd20-1dc970e29f0c {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:17.544599 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b4726431-df94-4e92-ac6f-29e1ce476805 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 204 len: 0 microversion: 2.1 time: 0.119523 Aug 04 02:23:17.545367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 350/705] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:17 2022] DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:17.555430 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:17.556139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:17.563054 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.563466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2b40de90-2244-4b14-b92b-6b1f19e2d91b tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/fecac6cf-373a-4f0c-80c7-00c5ccbcc220" status: 202 len: 0 microversion: 2.1 time: 0.177613 Aug 04 02:23:17.563602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.564098 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 356/706] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:23:17 2022] DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments/fecac6cf-373a-4f0c-80c7-00c5ccbcc220 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:23:17.564414 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:17.565046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:17.698446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:17.701943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.707296 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4b1456f6-b272-4e99-82d6-d3ab77209dbc tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1682 microversion: 2.1 time: 0.156763 Aug 04 02:23:17.707854 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 351/707] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:17 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:18.731326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:18.732644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:18.740035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:18.740490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:18.747438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:18.747438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:18.875303 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:18.882846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7c62a3f9-5484-49c2-bf59-de30b3597eaf tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1682 microversion: 2.1 time: 0.157501 Aug 04 02:23:18.883342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 357/708] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:18 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:19.802220 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:19.804130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:19.812875 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.813321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:19.814096 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.814537 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:19.843709 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-337fc687-0458-4f5d-8317-d7de6d07cced tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046100 Aug 04 02:23:19.844264 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 352/709] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:19 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:23:19.904312 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:19.905134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:19.912304 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.912872 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:19.914039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.914752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:19.936272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.970672 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:19.973321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:19.979748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.980199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:19.981031 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:19.981469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.012506 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bd52f413-abe2-4463-9b33-5bef4ba87b80 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046361 Aug 04 02:23:20.013143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 353/710] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:23:19 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 02:23:20.084579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:20.085101 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:20.091773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:20.092230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.093307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:20.093745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.120540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:23:20.205863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-98c79044-e581-40de-b946-f99f27bc1615 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 204 len: 0 microversion: 2.1 time: 0.125016 Aug 04 02:23:20.206884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 354/711] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:20 2022] DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:20.215433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:20.216139 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:20.222461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:20.223091 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.223861 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:20.224292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.398293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:20.408133 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-bfafb701-0dc2-4075-965d-d5aa7f9f3be4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1682 microversion: 2.1 time: 0.508030 Aug 04 02:23:20.409027 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 358/712] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:19 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1682 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:20.446782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:20.454475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b1346b89-884e-40ad-96db-6ac7f763a88f tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1674 microversion: 2.1 time: 0.243083 Aug 04 02:23:20.455048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 355/713] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:20 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:20.805368 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-5aabd0d6-4c82-4360-8303-c93f0aeb5d5e req-a5a3c427-0eca-49f9-9f9b-f240ea99226c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54afe06e-392b-455f-93ac-4e6471433b8b", "name": "network-vif-deleted", "tag": "06fdec2e-918d-4e19-b051-7f47fc105a20"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:20.815561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-5aabd0d6-4c82-4360-8303-c93f0aeb5d5e req-a5a3c427-0eca-49f9-9f9b-f240ea99226c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:20.816080 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-5aabd0d6-4c82-4360-8303-c93f0aeb5d5e req-a5a3c427-0eca-49f9-9f9b-f240ea99226c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:20.830915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-5aabd0d6-4c82-4360-8303-c93f0aeb5d5e req-a5a3c427-0eca-49f9-9f9b-f240ea99226c service nova] Creating event network-vif-deleted:06fdec2e-918d-4e19-b051-7f47fc105a20 for instance 54afe06e-392b-455f-93ac-4e6471433b8b on hv-cinder-74014 Aug 04 02:23:20.836796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-5aabd0d6-4c82-4360-8303-c93f0aeb5d5e req-a5a3c427-0eca-49f9-9f9b-f240ea99226c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097889 Aug 04 02:23:20.837910 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 359/714] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:21.430098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:21.430751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:21.437774 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:21.438225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:21.438997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:21.439437 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:21.480594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:21.482589 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:21.492435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:21.493286 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:21.494242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:21.495344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:21.512524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76703dc82dc644ef8d32f7e259ddea6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f003cc2b7104c369e1aa74d6e48a9fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:21.522273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f1751be8-a771-4013-b368-e18edfb770f1 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 200 len: 1615 microversion: 2.1 time: 0.095819 Aug 04 02:23:21.522791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 356/715] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:21 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:21.650082 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:21.658352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5564c515-ec3b-4a5c-b84c-0d691f27a9ee tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1674 microversion: 2.1 time: 0.186167 Aug 04 02:23:21.659502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 360/716] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:21 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:22.546641 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:22.547187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:22.553533 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:22.553968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:22.554731 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:22.555767 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:22.568956 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b HTTP/1.1 Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:22.570587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:22.572172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '54afe06e-392b-455f-93ac-4e6471433b8b'} Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:22.573333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:22.574874 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:22.576024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:22.576024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-921e9ce8-50c2-48b2-8e62-68ec1b983721 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 404 len: 111 microversion: 2.1 time: 0.029486 Aug 04 02:23:22.576024 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 357/717] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:22 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:22.581488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f6f4c3e9-994a-4ac1-9a86-f252e6ff8de6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '.version_select at 0x7ff48f54f820>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:22.590544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=44 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:22.606163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f6f4c3e9-994a-4ac1-9a86-f252e6ff8de6 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435557967" status: 202 len: 0 microversion: 2.1 time: 0.028866 Aug 04 02:23:22.607062 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 361/718] 10.222.0.45 () {58 vars in 1221 bytes} [Thu Aug 4 02:23:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435557967 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:23:22.681473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:22.682085 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:22.690300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:22.690869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:22.691890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:22.692391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:22.934593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26e73db77d93496883b66572d6bf35f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c32d82cce6541718e46908eaf9b98e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:22.951872 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-76b1a08f-8ea4-47cc-9f53-b390d0809d48 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 200 len: 1674 microversion: 2.1 time: 0.274170 Aug 04 02:23:22.954477 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 358/719] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:22 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:23.276373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-1b150b0b-2cc4-4f3d-b7c3-59fe78175956 req-20ae2852-3b03-4940-b97c-ef9e2da3ac17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa887f75-631c-4fb1-bd20-1dc970e29f0c", "name": "network-vif-deleted", "tag": "7a967bf2-982f-49f8-91e4-16df519c5536"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:23.302571 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-1b150b0b-2cc4-4f3d-b7c3-59fe78175956 req-20ae2852-3b03-4940-b97c-ef9e2da3ac17 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:23.303573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-1b150b0b-2cc4-4f3d-b7c3-59fe78175956 req-20ae2852-3b03-4940-b97c-ef9e2da3ac17 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:23.343204 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-1b150b0b-2cc4-4f3d-b7c3-59fe78175956 req-20ae2852-3b03-4940-b97c-ef9e2da3ac17 service nova] Creating event network-vif-deleted:7a967bf2-982f-49f8-91e4-16df519c5536 for instance fa887f75-631c-4fb1-bd20-1dc970e29f0c on hv-cinder-74014 Aug 04 02:23:23.353301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-1b150b0b-2cc4-4f3d-b7c3-59fe78175956 req-20ae2852-3b03-4940-b97c-ef9e2da3ac17 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078075 Aug 04 02:23:23.360058 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 362/720] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:23.975147 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:23.975777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:23.983211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:23.984432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:23.985295 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:23.985745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.001544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c HTTP/1.1 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:24.003084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:24.004524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'fa887f75-631c-4fb1-bd20-1dc970e29f0c'} Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:24.005282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:24.006452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.009050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:24.010122 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2730f933-1d75-45ea-8d5c-a0ffb97a20e2 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 404 len: 111 microversion: 2.1 time: 0.039209 Aug 04 02:23:24.010857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 359/721] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:23 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:24.020549 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-07c7226b-fd2e-4db7-adfd-cc39699583ab tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '.version_select at 0x7ff48f5a04c0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:24.043263 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-07c7226b-fd2e-4db7-adfd-cc39699583ab tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687404033" status: 202 len: 0 microversion: 2.1 time: 0.027215 Aug 04 02:23:24.044731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 363/722] 10.222.0.45 () {58 vars in 1221 bytes} [Thu Aug 4 02:23:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687404033 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:23:24.168564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:24.169111 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:24.181616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.182093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.184371 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.184876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.220468 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:23:24.279805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-95ab11d5-e336-40dc-8a92-4562ca64ad8a req-c4fc7563-7404-4e4c-a4f0-384a7fbb2bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:24.304761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-95ab11d5-e336-40dc-8a92-4562ca64ad8a req-c4fc7563-7404-4e4c-a4f0-384a7fbb2bc1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.305376 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-95ab11d5-e336-40dc-8a92-4562ca64ad8a req-c4fc7563-7404-4e4c-a4f0-384a7fbb2bc1 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.321304 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-95ab11d5-e336-40dc-8a92-4562ca64ad8a req-c4fc7563-7404-4e4c-a4f0-384a7fbb2bc1 service nova] Creating event network-changed:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:23:24.326436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-95ab11d5-e336-40dc-8a92-4562ca64ad8a req-c4fc7563-7404-4e4c-a4f0-384a7fbb2bc1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152557 Aug 04 02:23:24.327525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 364/723] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:23:24.351560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6bf19f1c-c5cf-443b-9cce-110230d1163f tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "DELETE /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 204 len: 0 microversion: 2.1 time: 0.186191 Aug 04 02:23:24.352845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 360/724] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:24 2022] DELETE /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:24.365994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:24.366714 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:24.376650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.377117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.378097 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.379733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.608844 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:24.620321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4a7cc063-8e33-4583-841b-3ce08fbffca1 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.262293 Aug 04 02:23:24.625215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 365/725] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:24 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:24.916154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:24.917257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:24.924036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.924493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.925336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.925778 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.941971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b HTTP/1.1 Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:24.944093 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.945442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '54afe06e-392b-455f-93ac-4e6471433b8b'} Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:24.946154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.947880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.949253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:24.949253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cb8fb2b0-935b-4793-9acc-e84a053a0ddb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 404 len: 111 microversion: 2.1 time: 0.033920 Aug 04 02:23:24.949253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 361/726] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:24 2022] DELETE /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:24.962462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:24.963291 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: 54afe06e-392b-455f-93ac-4e6471433b8b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:24.970095 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.970619 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.971507 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:24.972045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:24.987460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b HTTP/1.1 Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:24.989229 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.990630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '54afe06e-392b-455f-93ac-4e6471433b8b'} Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:24.991512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. Aug 04 02:23:24.992925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:24.994478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance 54afe06e-392b-455f-93ac-4e6471433b8b could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:24.994478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-12accaf3-7a49-44f5-9a0f-c0d6264c3656 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b" status: 404 len: 111 microversion: 2.1 time: 0.034410 Aug 04 02:23:24.994478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 366/727] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:24 2022] GET /compute/v2.1/servers/54afe06e-392b-455f-93ac-4e6471433b8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:25.645973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:25.646713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:25.653581 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:25.654027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:25.654806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:25.655242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:25.835214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:25.843855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-dfdb6db3-9b55-40a5-9c6b-8c74f300dccf tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1568 microversion: 2.1 time: 0.201030 Aug 04 02:23:25.844420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 362/728] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:25 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:26.163115 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:26.163597 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:26.170219 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.170675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.171511 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.171922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.185282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f HTTP/1.1 Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:26.186824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.188341 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'b2ea8a47-0d01-4e68-95e5-31a9977ac13f'} Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:26.189207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.190430 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.191564 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:26.191564 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-06f58e64-d71c-49b3-8706-e8c59abb5f45 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 404 len: 111 microversion: 2.1 time: 0.029068 Aug 04 02:23:26.191564 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 367/729] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:26 2022] DELETE /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:26.196964 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:26.197582 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: b2ea8a47-0d01-4e68-95e5-31a9977ac13f] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:26.204386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.204819 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.205595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.206067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.220208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f HTTP/1.1 Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:26.221755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.223130 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'b2ea8a47-0d01-4e68-95e5-31a9977ac13f'} Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:26.223933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. Aug 04 02:23:26.225321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.226439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance b2ea8a47-0d01-4e68-95e5-31a9977ac13f could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:26.226439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-eb8b47d5-f206-4991-995c-8d5c4a1d1aa4 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f" status: 404 len: 111 microversion: 2.1 time: 0.029983 Aug 04 02:23:26.226439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 363/730] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:26 2022] GET /compute/v2.1/servers/b2ea8a47-0d01-4e68-95e5-31a9977ac13f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:26.231663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:26.232155 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:26.238290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.238732 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.239501 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.239929 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.253908 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca HTTP/1.1 Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:26.255451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.257059 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'f015ef38-a9bb-426d-9007-f937d566d0ca'} Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:26.258292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.259815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.261361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:26.261361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b847c682-460e-4d82-8d17-10dd3adf558c tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 404 len: 111 microversion: 2.1 time: 0.028987 Aug 04 02:23:26.261361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 368/731] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:26 2022] DELETE /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:26.266058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:26.266716 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f015ef38-a9bb-426d-9007-f937d566d0ca] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:26.273080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.273395 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.274294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.274739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.289636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca HTTP/1.1 Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:26.291247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.292577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'f015ef38-a9bb-426d-9007-f937d566d0ca'} Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:26.297339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. Aug 04 02:23:26.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:26.299647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f015ef38-a9bb-426d-9007-f937d566d0ca could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:26.299647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1a12ed85-538e-4676-95b7-6f4bf0096d0e tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca" status: 404 len: 111 microversion: 2.1 time: 0.031050 Aug 04 02:23:26.299647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 364/732] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:26 2022] GET /compute/v2.1/servers/f015ef38-a9bb-426d-9007-f937d566d0ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:26.434001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-79719f08-b937-4820-8a66-7365f18f545d req-1a9b37f1-b8d9-4304-a8d6-1531971aba2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135cf505-eb65-44df-b01d-9298d43f41ee", "name": "network-vif-deleted", "tag": "28e195d3-7f8d-4186-a5a3-77d9701c1821"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:26.444179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-79719f08-b937-4820-8a66-7365f18f545d req-1a9b37f1-b8d9-4304-a8d6-1531971aba2f service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.444670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-79719f08-b937-4820-8a66-7365f18f545d req-1a9b37f1-b8d9-4304-a8d6-1531971aba2f service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.455991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-79719f08-b937-4820-8a66-7365f18f545d req-1a9b37f1-b8d9-4304-a8d6-1531971aba2f service nova] Creating event network-vif-deleted:28e195d3-7f8d-4186-a5a3-77d9701c1821 for instance 135cf505-eb65-44df-b01d-9298d43f41ee on hv-cinder-74014 Aug 04 02:23:26.461422 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-79719f08-b937-4820-8a66-7365f18f545d req-1a9b37f1-b8d9-4304-a8d6-1531971aba2f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030968 Aug 04 02:23:26.462019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 369/733] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:26.865505 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:26.867058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:26.873454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.875404 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.875797 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.876239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.923349 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:26.923769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:26.924382 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lazy-loading 'fault' on Instance uuid 135cf505-eb65-44df-b01d-9298d43f41ee {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:26.966968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bf0abff172401bb62653e975c91f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f54ee4ba204ceb982f8e4ad5dee102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:26.975661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d86186d4-6777-481b-8681-2c8161949cbb tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 200 len: 1223 microversion: 2.1 time: 0.114106 Aug 04 02:23:26.976222 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 365/734] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:26 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:27.462881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:27.465737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:27.473273 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.473729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.474550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.474917 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:27.475030 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.475411 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:27.482306 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.482756 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.483528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.483957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.489068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 HTTP/1.1 Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:27.490897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.492306 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'f5204e1c-198d-4f48-82e4-b7235cdc9e68'} Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:27.493069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.494232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.497088 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:27.497956 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-daf0a62c-5747-481f-9b7f-9d08dc771599 tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 404 len: 111 microversion: 2.1 time: 0.041247 Aug 04 02:23:27.498111 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.498525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 370/735] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:27 2022] DELETE /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c HTTP/1.1 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:27.502388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.503686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'fa887f75-631c-4fb1-bd20-1dc970e29f0c'} Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:27.504386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.505942 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.508560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:27.508560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e1230a86-6d80-4dbd-a164-e9b029195992 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 404 len: 111 microversion: 2.1 time: 0.034265 Aug 04 02:23:27.508560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 366/736] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:27 2022] DELETE /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:27.511326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:27.512238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:27.512359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] [instance: f5204e1c-198d-4f48-82e4-b7235cdc9e68] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:27.513083 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: fa887f75-631c-4fb1-bd20-1dc970e29f0c] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:27.520236 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.520750 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.521094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.521558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.521669 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.522002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.522462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:27.522983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:27.538207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.540044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] HTTP exception thrown: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c HTTP/1.1 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:27.540469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.541791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'fa887f75-631c-4fb1-bd20-1dc970e29f0c'} Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:27.542518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. Aug 04 02:23:27.543705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Request method failure captured: Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 HTTP/1.1 Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywpisT6INbxgIfL6nKVmxi2PSscD_Q6wcWqfXtQ0VeDMESqTLBcdLgMZk6xNuMo2p7ovVaX3rLqEaB-d7rtoPXJwJCXMbIZreBYPDRsKq14aF4hJDlMN5cgSeIJaClzdWfuagUgY2wVo2GlcygLgAwGy9st0xYbr5KLe9JLdekcq1c Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:27.547694 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f003cc2b7104c369e1aa74d6e48a9fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 2f003cc2b7104c369e1aa74d6e48a9fc Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1880983379 Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 76703dc82dc644ef8d32f7e259ddea6f Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeNegativeTest-1880983379-project Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.549106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'f5204e1c-198d-4f48-82e4-b7235cdc9e68'} Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:27.551276 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. Aug 04 02:23:27.553179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:27.556649 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] Returning 404 to user: Instance f5204e1c-198d-4f48-82e4-b7235cdc9e68 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:27.557679 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b033da61-f062-478a-892e-92ae22ec75bb tempest-AttachVolumeNegativeTest-1880983379 tempest-AttachVolumeNegativeTest-1880983379-project] 10.222.0.45 "GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68" status: 404 len: 111 microversion: 2.1 time: 0.054499 Aug 04 02:23:27.557992 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance fa887f75-631c-4fb1-bd20-1dc970e29f0c could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:27.558852 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 371/737] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:27 2022] GET /compute/v2.1/servers/f5204e1c-198d-4f48-82e4-b7235cdc9e68 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:23:27.559248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a4e47131-f6ec-4939-a0b6-aa0275636057 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c" status: 404 len: 111 microversion: 2.1 time: 0.050505 Aug 04 02:23:27.565860 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 367/738] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:27 2022] GET /compute/v2.1/servers/fa887f75-631c-4fb1-bd20-1dc970e29f0c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:27.996840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:27.997557 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] [instance: 135cf505-eb65-44df-b01d-9298d43f41ee] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:28.016578 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.017057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.017838 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.018457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.033589 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] HTTP exception thrown: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Request method failure captured: Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee HTTP/1.1 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6yxgdFUCCXz7JriVpt2ccWl3Y4YwAhb9RFZwerO862CJdXlebaLiHlUemeyvyB2wSVEghOmmFdyRFNdU2Yri2n2z9ZBq8YckUdyyux9Qx11d8zukE_SUsQ3nNvaFJrr_nrX0p7-yI_tJ6TSWOrXXDjbLIUZmiJwE53S7HpZ6CDTW-qo Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: d7f54ee4ba204ceb982f8e4ad5dee102 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestShelveInstance-970995010 Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:28.035096 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d7f54ee4ba204ceb982f8e4ad5dee102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d7f54ee4ba204ceb982f8e4ad5dee102"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d7f54ee4ba204ceb982f8e4ad5dee102"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d7f54ee4ba204ceb982f8e4ad5dee102"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestShelveInstance-970995010 Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: d7f54ee4ba204ceb982f8e4ad5dee102 Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestShelveInstance-970995010 Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestShelveInstance-970995010-project Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 11bf0abff172401bb62653e975c91f45 Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestShelveInstance-970995010-project Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. Aug 04 02:23:28.036406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '135cf505-eb65-44df-b01d-9298d43f41ee'} Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:28.037223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. Aug 04 02:23:28.038632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.039657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Returning 404 to user: Instance 135cf505-eb65-44df-b01d-9298d43f41ee could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:28.039657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e2a66ec4-647b-4eb0-9b6e-068ee7185d12 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee" status: 404 len: 111 microversion: 2.1 time: 0.043666 Aug 04 02:23:28.039657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 372/739] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:27 2022] GET /compute/v2.1/servers/135cf505-eb65-44df-b01d-9298d43f41ee => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:28.222262 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-64f5326d-ddbb-45c4-bc4b-9a39fa54d4d2 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] Calling method '.version_select at 0x7ff48f5a5dc0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:28.246839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-64f5326d-ddbb-45c4-bc4b-9a39fa54d4d2 tempest-TestShelveInstance-970995010 tempest-TestShelveInstance-970995010-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1824030816" status: 202 len: 0 microversion: 2.1 time: 0.028578 Aug 04 02:23:28.250143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 368/740] 10.222.0.45 () {58 vars in 1254 bytes} [Thu Aug 4 02:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1824030816 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 02:23:28.731411 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:28.732782 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:28.741205 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.741845 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.743042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.743859 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.764463 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 HTTP/1.1 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:28.767067 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.768481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '36731bfb-cc25-4fcc-8c46-b4abfad95a16'} Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:28.769242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.770404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.773028 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:28.774176 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-aff46e1f-0f58-4d56-88c2-55e7e14df756 tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 404 len: 111 microversion: 2.1 time: 0.048232 Aug 04 02:23:28.775016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 373/741] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:28 2022] DELETE /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:28.783427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:28.784441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] [instance: 36731bfb-cc25-4fcc-8c46-b4abfad95a16] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:28.796746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.797375 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.800095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:28.801812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:28.839951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] HTTP exception thrown: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Request method failure captured: Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 HTTP/1.1 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywuibAvRSn_XQwbpYfu9YiACOfWlPDwrAOJzBRbNJgX1LkcKEKJClD4I4IKkkoLvyc7V1THBiB1c6vJnlgKnkXwrhJTVDqidCiCYqUYVWJl-zlKnuRhZV8GoOvJaSgf9L2KguPPEtOvk9T2eDMGM1ll_mZcQGdObfRKoQp64LwNNvw Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:28.841561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1c32d82cce6541718e46908eaf9b98e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 1c32d82cce6541718e46908eaf9b98e9 Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-417467766 Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 26e73db77d93496883b66572d6bf35f2 Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeTestJSON-417467766-project Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.842870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '36731bfb-cc25-4fcc-8c46-b4abfad95a16'} Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:28.843912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. Aug 04 02:23:28.845734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:28.847415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] Returning 404 to user: Instance 36731bfb-cc25-4fcc-8c46-b4abfad95a16 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:28.847415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-52a1222a-98af-4622-8fe6-ef47f579296e tempest-AttachVolumeTestJSON-417467766 tempest-AttachVolumeTestJSON-417467766-project] 10.222.0.45 "GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16" status: 404 len: 111 microversion: 2.1 time: 0.063532 Aug 04 02:23:28.847415 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 369/742] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:28 2022] GET /compute/v2.1/servers/36731bfb-cc25-4fcc-8c46-b4abfad95a16 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:30.069131 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-927665886", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:30.127526 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] validate_networks() for None {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:23:30.876458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:23:30.876974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:23:30.877717 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:23:30.878128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:23:30.878877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:23:30.887402 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:30.887847 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:30.888781 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:30.889086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:30.912915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Getting quotas for project 19eead1456de4c6b9a2a0b0524674f0f. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:23:30.920125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Getting quotas for user 937131b7fd0048bf97cc2d0b5c3504f2 and project 19eead1456de4c6b9a2a0b0524674f0f. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:23:30.948016 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:23:30.950481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:23:31.008369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fa6e6ed5-3272-4b44-8ab9-82ef78144ee1 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942874 Aug 04 02:23:31.009392 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 374/743] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 02:23:31.021551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6ae15573-199f-4717-b72a-725ca3a8506d tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:31.022319 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6ae15573-199f-4717-b72a-725ca3a8506d tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:31.025517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.166434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6ae15573-199f-4717-b72a-725ca3a8506d tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:31.174706 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6ae15573-199f-4717-b72a-725ca3a8506d tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1214 microversion: 2.1 time: 0.157754 Aug 04 02:23:31.176121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 370/744] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:31 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:32.198569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:32.199444 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:32.214303 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:32.215311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:32.216298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:32.216987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:32.514506 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:32.522891 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c80cba7a-4992-418a-8be4-c05e52cb7fbb tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1284 microversion: 2.1 time: 0.330750 Aug 04 02:23:32.526640 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 375/745] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:32 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:33.547792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:33.548433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:33.565383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:33.565935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:33.567219 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:33.567669 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:33.701812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:33.712789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-94fbf920-a5d2-4a9f-9186-a18b242036a4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1272 microversion: 2.1 time: 0.169171 Aug 04 02:23:33.716859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 371/746] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:33 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:34.739446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:34.740827 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:34.752577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:34.753298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:34.755364 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:34.756925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:34.766110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:34.854241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0e75d97-faa4-40c3-9ca7-a4bb4bf1dbdf tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Action: 'create', calling method: .version_select at 0x7ff48f54f700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1711862235", "metadata": {"Type": "work"}}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0e75d97-faa4-40c3-9ca7-a4bb4bf1dbdf tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 122 Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:34.867849 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1711862235", "metadata": {"Type": "work"}}} Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:34.869555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1711862235', 'metadata': {'Type': 'work'}}}} Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:34.875985 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:23:34.880944 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0e75d97-faa4-40c3-9ca7-a4bb4bf1dbdf tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b0e75d97-faa4-40c3-9ca7-a4bb4bf1dbdf tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.257727 Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 376/747] 10.222.0.45 () {60 vars in 1156 bytes} [Thu Aug 4 02:23:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:34.882687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-75826e57-964f-4217-8763-e90754da79bc tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Action: 'create', calling method: .version_select at 0x7ff48f57b430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2086102079", "metadata": {"Type": "work"}}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-75826e57-964f-4217-8763-e90754da79bc tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 120 Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:34.885960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2086102079", "metadata": {"Type": "work"}}} Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:34.887833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2086102079', 'metadata': {'Type': 'work'}}}} Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi '0' Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:34.893807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:23:34.896086 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:23:34.897518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 02:23:34.897518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.897518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-75826e57-964f-4217-8763-e90754da79bc tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:34.897518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-75826e57-964f-4217-8763-e90754da79bc tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011543 Aug 04 02:23:34.897518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 377/748] 10.222.0.45 () {60 vars in 1156 bytes} [Thu Aug 4 02:23:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:34.898943 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fe78bb67-72d0-46b2-b0a7-2ac0020b33e5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Action: 'create', calling method: .version_select at 0x7ff48f57b550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750749571", "metadata": {"Type": "work"}}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fe78bb67-72d0-46b2-b0a7-2ac0020b33e5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 119 Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:34.910476 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750749571", "metadata": {"Type": "work"}}} Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:34.916165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1750749571', 'metadata': {'Type': 'work'}}}} Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise error Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi '' Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:34.917279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 02:23:34.919004 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 02:23:34.920375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 02:23:34.920375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.920375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fe78bb67-72d0-46b2-b0a7-2ac0020b33e5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:34.920375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fe78bb67-72d0-46b2-b0a7-2ac0020b33e5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015910 Aug 04 02:23:34.920375 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 378/749] 10.222.0.45 () {60 vars in 1156 bytes} [Thu Aug 4 02:23:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:34.927363 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-568da9e9-0544-418d-89cc-019b0984d6d5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Calling method '.version_select at 0x7ff48f57ca60>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:34.961025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-568da9e9-0544-418d-89cc-019b0984d6d5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] HTTP exception thrown: Volume tempest-invalid-407731616 could not be found. Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-568da9e9-0544-418d-89cc-019b0984d6d5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-407731616 HTTP/1.1 Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:34.963017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Volume tempest-invalid-407731616 could not be found. Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'tempest-invalid-407731616'} Aug 04 02:23:34.964716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-407731616 could not be found. (HTTP 404) (Request-ID: req-d13fc7b9-ad65-469a-b357-0173024a9f60) Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.965657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:23:34.967914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-407731616 could not be found. Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:34.969787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-407731616 could not be found. Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-407731616 could not be found. Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-568da9e9-0544-418d-89cc-019b0984d6d5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 404 to user: Volume tempest-invalid-407731616 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-568da9e9-0544-418d-89cc-019b0984d6d5 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-407731616" status: 404 len: 98 microversion: 2.1 time: 0.046357 Aug 04 02:23:34.970994 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 379/750] 10.222.0.45 () {58 vars in 1215 bytes} [Thu Aug 4 02:23:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-407731616 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 02:23:34.985159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0a4c8c63-e37e-41db-a0d6-193023b3972c tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005140 Aug 04 02:23:34.986462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 380/751] 10.222.0.45 () {58 vars in 1140 bytes} [Thu Aug 4 02:23:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 02:23:34.996405 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c1dc868f-3c8b-4e3b-aa6b-6c9ec3c09c7e tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004354 Aug 04 02:23:34.997227 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 381/752] 10.222.0.45 () {58 vars in 1137 bytes} [Thu Aug 4 02:23:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 02:23:35.007401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0917da8-00d7-4052-bbd9-a8454e9c6466 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Calling method '.version_select at 0x7ff48f57c280>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:35.057656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-b0917da8-00d7-4052-bbd9-a8454e9c6466 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] HTTP exception thrown: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0917da8-00d7-4052-bbd9-a8454e9c6466 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/os-volumes/d8836229-f87a-456d-b086-d9310ba75638 HTTP/1.1 Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:35.060310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'd8836229-f87a-456d-b086-d9310ba75638'} Aug 04 02:23:35.062230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. (HTTP 404) (Request-ID: req-aa4647e0-703f-4b83-9a4c-914fa7ba72ab) Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.063203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 02:23:35.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 02:23:35.065721 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. Aug 04 02:23:35.067018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.070800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b0917da8-00d7-4052-bbd9-a8454e9c6466 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 404 to user: Volume d8836229-f87a-456d-b086-d9310ba75638 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:35.070800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b0917da8-00d7-4052-bbd9-a8454e9c6466 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/d8836229-f87a-456d-b086-d9310ba75638" status: 404 len: 109 microversion: 2.1 time: 0.067371 Aug 04 02:23:35.070800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 382/753] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:23:35 2022] DELETE /compute/v2.1/os-volumes/d8836229-f87a-456d-b086-d9310ba75638 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 02:23:35.083504 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be7713e9-6f4e-4237-bdc7-a75b39a84f13 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Calling method '.version_select at 0x7ff48f57b430>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:35.083946 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:35.095496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-765df5cb-3591-4d5a-9689-f262eeecdd84 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.360698 Aug 04 02:23:35.097266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 372/754] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:34 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:35.137800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-be7713e9-6f4e-4237-bdc7-a75b39a84f13 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] HTTP exception thrown: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be7713e9-6f4e-4237-bdc7-a75b39a84f13 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Request method failure captured: Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/os-volumes/e07ec531-fade-4fab-a48d-3aad3eba0e9b HTTP/1.1 Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y2mBQpQLbBbBFeI87kowT3nTCnBJ2onmR4nt9K2Ez3pUqmT7reHWOy7IxO-Xla3BZfqdjlGHhM02gHt5EmWW1Y0W14gnIgPeDZHx09sum4job8IfACNEgpM2e4lK2H1IucBx4HdvKgWsrpGVXb1q6DcqAQL8-6Kbznr9fYaVvbYLRQ Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:35.140068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0846ad04fd624ae6b5a4878f2ffb021b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 0846ad04fd624ae6b5a4878f2ffb021b Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesNegativeTest-1937751797 Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 5a9e1d1f299a46e69bf7fefbfa49d2e1 Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesNegativeTest-1937751797-project Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'e07ec531-fade-4fab-a48d-3aad3eba0e9b'} Aug 04 02:23:35.142157 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. (HTTP 404) (Request-ID: req-2fe68646-16f6-4302-838b-1dc8dc2a08df) Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.143064 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:23:35.144371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:23:35.145789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be7713e9-6f4e-4237-bdc7-a75b39a84f13 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] Returning 404 to user: Volume e07ec531-fade-4fab-a48d-3aad3eba0e9b could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-be7713e9-6f4e-4237-bdc7-a75b39a84f13 tempest-VolumesNegativeTest-1937751797 tempest-VolumesNegativeTest-1937751797-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e07ec531-fade-4fab-a48d-3aad3eba0e9b" status: 404 len: 109 microversion: 2.1 time: 0.065913 Aug 04 02:23:35.147241 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 383/755] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:23:35 2022] GET /compute/v2.1/os-volumes/e07ec531-fade-4fab-a48d-3aad3eba0e9b => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:36.117411 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:36.119032 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:36.128025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:36.129351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:36.130386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:36.131048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:36.292935 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-0a76b4ed-49a7-4d2f-bdae-1fca85defd70 req-569a8c23-6bde-4761-935f-e2a666d08eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c454e63-0bf0-4ef0-b980-3997270ad9bd", "tag": "d11ca447-dee7-4bb9-86d4-11e8fdc20263"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:36.306896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0a76b4ed-49a7-4d2f-bdae-1fca85defd70 req-569a8c23-6bde-4761-935f-e2a666d08eec service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:36.307719 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0a76b4ed-49a7-4d2f-bdae-1fca85defd70 req-569a8c23-6bde-4761-935f-e2a666d08eec service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:36.322959 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-0a76b4ed-49a7-4d2f-bdae-1fca85defd70 req-569a8c23-6bde-4761-935f-e2a666d08eec service nova] Creating event network-changed:d11ca447-dee7-4bb9-86d4-11e8fdc20263 for instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd on hv-cinder-74014 Aug 04 02:23:36.331148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-0a76b4ed-49a7-4d2f-bdae-1fca85defd70 req-569a8c23-6bde-4761-935f-e2a666d08eec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044595 Aug 04 02:23:36.341645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 384/756] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:23:36.413761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:36.422880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2632f800-3410-4e28-b04b-82fb50177f1e tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.309114 Aug 04 02:23:36.426435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 373/757] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:36 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:37.448083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:37.449013 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:37.460997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:37.464418 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:37.465485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:37.466002 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:38.025095 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:38.042713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-06956020-9c6a-4775-a04f-bd8f81a56e40 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.598086 Aug 04 02:23:38.053898 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 385/758] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:37 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:39.067433 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:39.070687 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:39.084206 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:39.085014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:39.086788 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:39.087398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:39.483698 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:39.494121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-51f422a5-7e21-4995-9717-61fd7a92c5d3 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.432888 Aug 04 02:23:39.495745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 374/759] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:39 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:40.518487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:40.519850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:40.528932 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:40.529793 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:40.532073 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:40.532777 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:40.844933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:40.854892 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6348c3e2-4f52-4740-8d20-56b701bf707c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.344028 Aug 04 02:23:40.869262 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 386/760] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:40 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:41.877097 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:41.878440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:41.885769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.891817 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:41.892265 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:41.902058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:41.902624 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:42.138552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:42.151087 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7c0418ac-de92-4094-8c8a-39fe0564918f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.278688 Aug 04 02:23:42.166307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 375/761] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:41 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:42.835840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-fc4a16b2-ce7b-4b53-818c-bb040add69ca req-d617c204-f870-48ca-a12b-ad1b23d41609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c454e63-0bf0-4ef0-b980-3997270ad9bd", "name": "network-vif-plugged", "status": "completed", "tag": "d11ca447-dee7-4bb9-86d4-11e8fdc20263"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:42.844033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.845290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.853475 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-fc4a16b2-ce7b-4b53-818c-bb040add69ca req-d617c204-f870-48ca-a12b-ad1b23d41609 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:42.854735 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-fc4a16b2-ce7b-4b53-818c-bb040add69ca req-d617c204-f870-48ca-a12b-ad1b23d41609 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:42.872026 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-fc4a16b2-ce7b-4b53-818c-bb040add69ca req-d617c204-f870-48ca-a12b-ad1b23d41609 service nova] Creating event network-vif-plugged:d11ca447-dee7-4bb9-86d4-11e8fdc20263 for instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd on hv-cinder-74014 Aug 04 02:23:42.879334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-fc4a16b2-ce7b-4b53-818c-bb040add69ca req-d617c204-f870-48ca-a12b-ad1b23d41609 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050738 Aug 04 02:23:42.880494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 387/762] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:23:43.171794 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:43.172405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:43.181679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.182312 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.183556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.184518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.349482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:43.359878 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b03db206-b356-4218-ae7f-8313c2ec41e4 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.191342 Aug 04 02:23:43.360728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 376/763] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:43 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:43.489449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:43.493478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:43.502571 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.503521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.504544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.505211 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.553710 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-874f14c4-9614-44a4-95bd-250179d05531 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070609 Aug 04 02:23:43.556656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 388/764] 10.222.0.45 () {60 vars in 1343 bytes} [Thu Aug 4 02:23:43 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:43.626600 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:43.627119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:43.635259 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.635909 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.637400 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.638058 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.687620 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:23:43.785987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8f30599a-32f0-4ab4-a5ee-91527d76e03f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 204 len: 0 microversion: 2.20 time: 0.165550 Aug 04 02:23:43.786829 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 377/765] 10.222.0.45 () {60 vars in 1280 bytes} [Thu Aug 4 02:23:43 2022] DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 02:23:43.795525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:43.796232 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:43.804391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.805283 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.806289 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:43.806896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:43.955610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:43.966488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:43.968100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:43.970101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ea726ed9-da99-49c5-bc94-e98b5c56b01d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.178645 Aug 04 02:23:43.971183 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 389/766] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:43 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 02:23:44.382847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:44.393051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:44.409761 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:44.410229 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:44.411027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:44.411822 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:44.682923 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:44.691540 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ef210aa3-c453-455b-be6b-42b199c55980 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1314 microversion: 2.1 time: 0.314541 Aug 04 02:23:44.692418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 378/767] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:44 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:44.993676 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:44.994277 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:45.001321 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:45.001763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:45.003029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:45.003570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:45.278941 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:45.288537 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:45.290292 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:45.292073 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-613c7ca2-ca97-4202-af29-441d107b7a6d tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.301848 Aug 04 02:23:45.292661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 390/768] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:44 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:45.718041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:45.719577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:45.735579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:45.736255 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:45.739311 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:45.740986 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.317327 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:46.321521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:46.334143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.335051 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.336396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.337355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.366506 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:46.375646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-426e839e-e26b-4363-9ef6-639ba56555b8 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1463 microversion: 2.1 time: 0.663943 Aug 04 02:23:46.378094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 379/769] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:45 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1463 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:46.426768 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:46.427313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:46.436517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.437341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.438624 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.439299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.497957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:23:46.603332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-655766e2-da42-46b9-ab9a-552d9437452c tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 204 len: 0 microversion: 2.1 time: 0.181632 Aug 04 02:23:46.604044 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 380/770] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:23:46 2022] DELETE /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:46.615372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:46.616366 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:46.625595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.626300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.628562 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:46.629537 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:46.647522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:46.664652 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:46.666354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:46.669213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f522fdc0-5e0a-4db0-9e23-9659643fc61f tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1724 microversion: 2.20 time: 0.357740 Aug 04 02:23:46.676404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 391/771] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:46 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:46.971074 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:46.995290 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b3c007ec-fdaa-43c2-8982-15a1f734c914 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1469 microversion: 2.1 time: 0.385572 Aug 04 02:23:46.995873 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 381/772] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:46 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:47.222285 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-b968d4f1-14e9-4c0b-a9a7-b3c72acc6076 req-86f9108d-0f28-42ac-8245-6d452a597a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54da993a-75f6-4244-8ed1-2bf6bab0917b", "name": "network-vif-deleted", "tag": "e27a122d-e8ab-43dd-b688-af2ca492785b"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:47.246534 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b968d4f1-14e9-4c0b-a9a7-b3c72acc6076 req-86f9108d-0f28-42ac-8245-6d452a597a2c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:47.248213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b968d4f1-14e9-4c0b-a9a7-b3c72acc6076 req-86f9108d-0f28-42ac-8245-6d452a597a2c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:47.272642 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-b968d4f1-14e9-4c0b-a9a7-b3c72acc6076 req-86f9108d-0f28-42ac-8245-6d452a597a2c service nova] Creating event network-vif-deleted:e27a122d-e8ab-43dd-b688-af2ca492785b for instance 54da993a-75f6-4244-8ed1-2bf6bab0917b on hv-cinder-74014 Aug 04 02:23:47.282369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-b968d4f1-14e9-4c0b-a9a7-b3c72acc6076 req-86f9108d-0f28-42ac-8245-6d452a597a2c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063840 Aug 04 02:23:47.283805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 392/773] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:47.701700 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:47.703453 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:47.716273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:47.719957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:47.721318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:47.721957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:47.789814 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:47.790292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:47.792160 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lazy-loading 'fault' on Instance uuid 54da993a-75f6-4244-8ed1-2bf6bab0917b {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:47.851718 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:47.863804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:47.866893 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df5d3de1afa945c3b0873050eca06c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11284ae13d2f4c5ba47517f672968623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:47.868181 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f73a4802-083a-4337-8248-9a31bb855065 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 200 len: 1371 microversion: 2.20 time: 0.171328 Aug 04 02:23:47.885496 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 382/774] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:47 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 02:23:48.020824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:48.022159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:48.037137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:48.037610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:48.038470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:48.038922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:48.333240 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:48.343877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f1695098-b4dc-4ec6-9908-ec782fd2c862 tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1469 microversion: 2.1 time: 0.328876 Aug 04 02:23:48.353577 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 393/775] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:48 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:48.893056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:48.893864 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:48.908424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:48.909414 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:48.911280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:48.913781 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:48.950377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b HTTP/1.1 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:48.952333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:48.954466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '54da993a-75f6-4244-8ed1-2bf6bab0917b'} Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:48.955230 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:48.958454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:48.961350 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:48.961350 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-e8d30b14-661a-4d87-bd0d-67351cd3cba6 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 404 len: 111 microversion: 2.20 time: 0.070984 Aug 04 02:23:48.965774 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 383/776] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:48 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:48.969128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8dac7efc-bb37-4dea-bc8c-facdd03e6401 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '.version_select at 0x7ff48f5a0160>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:49.011567 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8dac7efc-bb37-4dea-bc8c-facdd03e6401 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200450374" status: 204 len: 0 microversion: 2.20 time: 0.047434 Aug 04 02:23:49.011829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 394/777] 10.222.0.45 () {60 vars in 1262 bytes} [Thu Aug 4 02:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200450374 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 02:23:49.309169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-0e75241b-c8c6-41e3-937f-d0c09aa8d8d5 req-c7e99e0f-0386-4f50-8835-edcb121386fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c454e63-0bf0-4ef0-b980-3997270ad9bd", "name": "network-vif-deleted", "tag": "d11ca447-dee7-4bb9-86d4-11e8fdc20263"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:23:49.332204 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0e75241b-c8c6-41e3-937f-d0c09aa8d8d5 req-c7e99e0f-0386-4f50-8835-edcb121386fa service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:49.332833 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0e75241b-c8c6-41e3-937f-d0c09aa8d8d5 req-c7e99e0f-0386-4f50-8835-edcb121386fa service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:49.378739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:49.379981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:49.393385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:49.397831 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:49.398900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:49.399585 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-0e75241b-c8c6-41e3-937f-d0c09aa8d8d5 req-c7e99e0f-0386-4f50-8835-edcb121386fa service nova] Creating event network-vif-deleted:d11ca447-dee7-4bb9-86d4-11e8fdc20263 for instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd on hv-cinder-74014 Aug 04 02:23:49.408594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:49.419187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-0e75241b-c8c6-41e3-937f-d0c09aa8d8d5 req-c7e99e0f-0386-4f50-8835-edcb121386fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114811 Aug 04 02:23:49.424246 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 384/778] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:23:49.573369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:49.573983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:49.576319 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lazy-loading 'fault' on Instance uuid 5c454e63-0bf0-4ef0-b980-3997270ad9bd {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:23:49.782129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937131b7fd0048bf97cc2d0b5c3504f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19eead1456de4c6b9a2a0b0524674f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:23:49.784906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:49.797359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b2c12116-bb2e-400b-aa0b-67c092ad4c5f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 200 len: 1304 microversion: 2.1 time: 0.421767 Aug 04 02:23:49.811025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 395/779] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:49 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 1304 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:50.819973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:50.820710 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] [instance: 5c454e63-0bf0-4ef0-b980-3997270ad9bd] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:50.832688 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:50.836214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:50.837165 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:50.837613 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:50.869179 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] HTTP exception thrown: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Request method failure captured: Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd HTTP/1.1 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y2g79L7C7Men5sbhLJHNFMAyX1u_y6icpHwo5DzZPxJjGsfzPi-7BctBsGOf66loug3i62fAOXUN3-yyUqTPqvE8ZSHQIUpweA0eKmyfX02N26a-l8r8wgJkAASxFd7tB7-whEdpUV-kRJr_HZaly9FHPRsOd4A5Z-tHGMravtlTL0 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 19eead1456de4c6b9a2a0b0524674f0f Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesNegativeTest-194474938 Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:50.870968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/19eead1456de4c6b9a2a0b0524674f0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_19eead1456de4c6b9a2a0b0524674f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/19eead1456de4c6b9a2a0b0524674f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/19eead1456de4c6b9a2a0b0524674f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesNegativeTest-194474938 Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 19eead1456de4c6b9a2a0b0524674f0f Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesNegativeTest-194474938 Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesNegativeTest-194474938-project Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 937131b7fd0048bf97cc2d0b5c3504f2 Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesNegativeTest-194474938-project Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. Aug 04 02:23:50.872550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '5c454e63-0bf0-4ef0-b980-3997270ad9bd'} Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:50.873439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. Aug 04 02:23:50.874734 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:50.875858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] Returning 404 to user: Instance 5c454e63-0bf0-4ef0-b980-3997270ad9bd could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:50.875858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ccc65ddc-5949-49f5-bfe0-bf671adc6a9f tempest-VolumesNegativeTest-194474938 tempest-VolumesNegativeTest-194474938-project] 10.222.0.45 "GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd" status: 404 len: 111 microversion: 2.1 time: 0.057292 Aug 04 02:23:50.875858 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 385/780] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:23:50 2022] GET /compute/v2.1/servers/5c454e63-0bf0-4ef0-b980-3997270ad9bd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:23:52.108078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:52.109197 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:52.117866 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:52.119298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:52.120660 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:52.121335 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:52.173339 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b HTTP/1.1 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:52.199239 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.200828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '54da993a-75f6-4244-8ed1-2bf6bab0917b'} Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:52.201584 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.203057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.208028 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:52.212938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-44d5195d-1647-4b96-bb9a-26bb2a36f2f2 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 404 len: 111 microversion: 2.20 time: 0.108900 Aug 04 02:23:52.214186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 396/781] 10.222.0.45 () {60 vars in 1280 bytes} [Thu Aug 4 02:23:52 2022] DELETE /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:52.225319 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:52.226346 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: 54da993a-75f6-4244-8ed1-2bf6bab0917b] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:52.249751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:52.252689 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:52.254780 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:52.255332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:52.298329 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b HTTP/1.1 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:52.304323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.306177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '54da993a-75f6-4244-8ed1-2bf6bab0917b'} Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:52.306951 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. Aug 04 02:23:52.308185 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:52.312667 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance 54da993a-75f6-4244-8ed1-2bf6bab0917b could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:52.317051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ebe3c31f-5669-46d2-b383-eb76e3f2f0e0 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b" status: 404 len: 111 microversion: 2.20 time: 0.096832 Aug 04 02:23:52.319843 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 386/782] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:52 2022] GET /compute/v2.1/servers/54da993a-75f6-4244-8ed1-2bf6bab0917b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:53.563999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:53.564758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:53.578283 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.585502 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:53.588230 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:53.590759 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:53.592372 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:53.636377 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 HTTP/1.1 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:23:53.639895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.642217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'a6b7c041-6233-4a90-8e9d-e2745bbb07a9'} Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:53.643160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.645024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.646473 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:53.648423 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ec0353b4-e50f-4e8a-9176-f336f4110054 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 404 len: 111 microversion: 2.20 time: 0.087362 Aug 04 02:23:53.649196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 397/783] 10.222.0.45 () {60 vars in 1280 bytes} [Thu Aug 4 02:23:53 2022] DELETE /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:23:53.659676 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:23:53.660374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] [instance: a6b7c041-6233-4a90-8e9d-e2745bbb07a9] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:23:53.686628 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:53.689032 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:53.689792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:23:53.690231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:23:53.712187 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] HTTP exception thrown: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Request method failure captured: Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 HTTP/1.1 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6ywnn21XxgJID88-5tQQFO8JU57FWVogIxg5_7ArVyn2PVm3pOhHqsLFvkxF7FM7Y5TDEvKaFFCkPPiV7CnLLP2UnnS62X6zdAx6ZTMCFAgf5VrMsIMfOd9cqYlmTgBcubUWweSB26wmXtyLMg98LlmVkAhZjCCKXyj3GAyRHlOhAtw Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:23:53.714154 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/11284ae13d2f4c5ba47517f672968623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 11284ae13d2f4c5ba47517f672968623 Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2063951619 Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: df5d3de1afa945c3b0873050eca06c0c Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2063951619-project Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.716078 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'a6b7c041-6233-4a90-8e9d-e2745bbb07a9'} Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:23:53.717038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. Aug 04 02:23:53.718464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:23:53.721318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] Returning 404 to user: Instance a6b7c041-6233-4a90-8e9d-e2745bbb07a9 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:23:53.722561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bd812660-e080-4258-a236-dc76c71c3cc3 tempest-AttachVolumeShelveTestJSON-2063951619 tempest-AttachVolumeShelveTestJSON-2063951619-project] 10.222.0.45 "GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9" status: 404 len: 111 microversion: 2.20 time: 0.068721 Aug 04 02:23:53.729057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 387/784] 10.222.0.45 () {60 vars in 1277 bytes} [Thu Aug 4 02:23:53 2022] GET /compute/v2.1/servers/a6b7c041-6233-4a90-8e9d-e2745bbb07a9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 02:24:00.177690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4e8d5c98-0455-457c-b7ce-87356b69bc82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Action: 'create', calling method: .version_select at 0x7ff48f53d3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1537706057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9mEo9JO/noZ2RgnHMOpvfW37KbhLjjWvKeLTeMvvuVq5rLhSyQyPLKG0laezi2BwRgM8MUI7GbYSDh7eiZZGXCiq/2tYrRTLeTvrZht3pNOMk07mSymHsGdZ1rXPeMZw=="}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:00.247527 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-4e8d5c98-0455-457c-b7ce-87356b69bc82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for project 5f4683550a9d40d1ab0439d002d73749. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:00.253678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-4e8d5c98-0455-457c-b7ce-87356b69bc82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for user 683f8f120df946f59505455a9ab2dc2a and project 5f4683550a9d40d1ab0439d002d73749. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:00.302021 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4e8d5c98-0455-457c-b7ce-87356b69bc82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.673754 Aug 04 02:24:00.312943 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 398/785] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:23:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:02.556506 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-02b616cb-bd39-4573-a232-29989c3f82f5 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Action: 'create', calling method: .version_select at 0x7ff48f560430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1058593589", "metadata": {"Type": "work"}}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:03.159755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-02b616cb-bd39-4573-a232-29989c3f82f5 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.890494 Aug 04 02:24:03.160461 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 388/786] 10.222.0.45 () {60 vars in 1156 bytes} [Thu Aug 4 02:24:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 892 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 02:24:03.173531 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-76574f46-dd0a-4cee-be50-03b8ddff1b35 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f539310>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:03.315947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-76574f46-dd0a-4cee-be50-03b8ddff1b35 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 200 len: 353 microversion: 2.1 time: 0.146797 Aug 04 02:24:03.321987 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 399/787] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:24:03 2022] GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:04.327301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:04.329912 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:04.335731 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ec03cf60-28b2-4fd8-bcdd-3c8e21ea7d9a tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f57e310>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:04.428100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ec03cf60-28b2-4fd8-bcdd-3c8e21ea7d9a tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 200 len: 354 microversion: 2.1 time: 0.102187 Aug 04 02:24:04.428853 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 389/788] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:24:04 2022] GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:04.443458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-64000e2b-301c-4630-af8f-0abd601c14e0 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f54c5e0>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:04.453045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=5 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:04.525495 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-64000e2b-301c-4630-af8f-0abd601c14e0 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 200 len: 354 microversion: 2.1 time: 0.087190 Aug 04 02:24:04.537713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 400/789] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:24:04 2022] GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:04.549276 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b52d0769-0179-4ffb-a36f-aa1575b04254 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f5ef160>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:04.674748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b52d0769-0179-4ffb-a36f-aa1575b04254 tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 202 len: 0 microversion: 2.1 time: 0.129532 Aug 04 02:24:04.679412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 390/790] 10.222.0.45 () {58 vars in 1248 bytes} [Thu Aug 4 02:24:04 2022] DELETE /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:24:04.690337 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6617da01-b5cf-4348-94eb-fa2a8cb4db6d tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f57fb80>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:04.759275 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6617da01-b5cf-4348-94eb-fa2a8cb4db6d tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 200 len: 353 microversion: 2.1 time: 0.073928 Aug 04 02:24:04.759850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 401/791] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:24:04 2022] GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:05.773972 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-72bb7734-dbb7-49c5-b1f3-6f8dc52135cd tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Calling method '.version_select at 0x7ff48f5d69d0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:05.824963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-72bb7734-dbb7-49c5-b1f3-6f8dc52135cd tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] HTTP exception thrown: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-72bb7734-dbb7-49c5-b1f3-6f8dc52135cd tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Request method failure captured: Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 HTTP/1.1 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y3Csba-BHvFHTTn0jDvcknXEf2nI-Nxf6WFMotom8WjNUt0HWTnbPsTXnBR_XnhFd5GpX3KcCMdFj8XrqXkvlnhhYseBp_AhovO7SbnETiHlIRxkjP2Te8w0fCb6I474LBOdMxMQcUV6RcFu4YNuWSFXjO967PmgJzRuRrBwqtV1wM Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 069304da63a0488880fb09c6c3af2ce6 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesGetTestJSON-531024686 Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:24:05.827413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/069304da63a0488880fb09c6c3af2ce6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_069304da63a0488880fb09c6c3af2ce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/069304da63a0488880fb09c6c3af2ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/069304da63a0488880fb09c6c3af2ce6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesGetTestJSON-531024686 Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 069304da63a0488880fb09c6c3af2ce6 Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesGetTestJSON-531024686 Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesGetTestJSON-531024686-project Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 89877030552f4954aa0e4ebbe6f6f9ba Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesGetTestJSON-531024686-project Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '374c28a5-4c49-40cf-a0df-c1e4b077a324'} Aug 04 02:24:05.829053 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. (HTTP 404) (Request-ID: req-0fc2b854-89f5-463d-a00f-5709ffeb79bc) Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:24:05.829983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 02:24:05.831579 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 02:24:05.833546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:05.835526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-72bb7734-dbb7-49c5-b1f3-6f8dc52135cd tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] Returning 404 to user: Volume 374c28a5-4c49-40cf-a0df-c1e4b077a324 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:24:05.837121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-72bb7734-dbb7-49c5-b1f3-6f8dc52135cd tempest-VolumesGetTestJSON-531024686 tempest-VolumesGetTestJSON-531024686-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324" status: 404 len: 109 microversion: 2.1 time: 0.065350 Aug 04 02:24:05.837640 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 391/792] 10.222.0.45 () {58 vars in 1245 bytes} [Thu Aug 4 02:24:05 2022] GET /compute/v2.1/os-volumes/374c28a5-4c49-40cf-a0df-c1e4b077a324 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:24:23.442932 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=4 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:23.443731 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:23.448024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2044106001", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537706057", "security_groups": [{"name": "tempest-secgroup-smoke-689449970"}], "block_device_mapping_v2": [{"uuid": "63ff9f45-d8f1-4ec8-ba7f-36171883e067", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4"}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:23.638697 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] validate_networks() for [('c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:24:24.358146 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:24:24.359439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:24:24.359919 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:24:24.360326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:24:24.360767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:24:24.373314 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:24.377259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:24.378391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:24.379101 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:24.397724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:24.402164 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for user 683f8f120df946f59505455a9ab2dc2a and project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:24.500403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:24:24.502518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63ff9f45-d8f1-4ec8-ba7f-36171883e067',volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:24:24.684087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-fb3bc50f-1fdd-4111-888a-22bcecee6543 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.242338 Aug 04 02:24:24.685675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 402/793] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:24:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:24:24.700563 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0ee364dc-d26e-4adb-b229-c747a0b6d3cd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:24.701222 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0ee364dc-d26e-4adb-b229-c747a0b6d3cd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:24.819742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0ee364dc-d26e-4adb-b229-c747a0b6d3cd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:24.829218 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0ee364dc-d26e-4adb-b229-c747a0b6d3cd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1095 microversion: 2.1 time: 0.135228 Aug 04 02:24:24.829803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 392/794] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:24 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1095 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:25.857901 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:25.860041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:25.871835 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:25.872723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:25.873918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:25.874523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:25.972483 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:25.989650 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c3f46b99-7f23-4bf5-a65e-0ac9f99baff5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1193 microversion: 2.1 time: 0.141316 Aug 04 02:24:25.991745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 403/795] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:25 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1193 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:27.013441 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:27.016376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:27.024661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:27.027007 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:27.030465 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:27.031575 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:27.277936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:27.285982 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6e161d27-7c86-4e1a-a836-4d8dc88cc2c5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.276477 Aug 04 02:24:27.286575 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 393/796] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:27 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:28.050769 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-69f9a154-b663-4bff-89f0-2f2deb80da70 req-6ba8a647-8398-41fe-933f-2cca9de403db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3332bb9-b241-4099-9834-2c22f1241a44", "tag": "11df299a-5e37-4167-9de3-78f09f622f02"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:28.065438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-69f9a154-b663-4bff-89f0-2f2deb80da70 req-6ba8a647-8398-41fe-933f-2cca9de403db service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:28.065980 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-69f9a154-b663-4bff-89f0-2f2deb80da70 req-6ba8a647-8398-41fe-933f-2cca9de403db service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:28.086807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-69f9a154-b663-4bff-89f0-2f2deb80da70 req-6ba8a647-8398-41fe-933f-2cca9de403db service nova] Creating event network-changed:11df299a-5e37-4167-9de3-78f09f622f02 for instance b3332bb9-b241-4099-9834-2c22f1241a44 on hv-cinder-74014 Aug 04 02:24:28.092365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-69f9a154-b663-4bff-89f0-2f2deb80da70 req-6ba8a647-8398-41fe-933f-2cca9de403db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045256 Aug 04 02:24:28.093853 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 404/797] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:28.306038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:28.307260 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:28.328267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:28.329464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:28.329464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:28.329938 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:28.536762 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:28.546645 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-acb8b972-106d-4fe4-b358-ba2267dd37f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.244602 Aug 04 02:24:28.547647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 394/798] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:28 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:28.876647 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2019149840", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "networks": [{"uuid": "82033b8a-fd6f-44a1-9a32-4b4326d62bc3"}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:28.958789 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] validate_networks() for [('82033b8a-fd6f-44a1-9a32-4b4326d62bc3', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:24:29.439645 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:24:29.440914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:24:29.441895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:24:29.442308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:24:29.443032 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:24:29.454296 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:29.455021 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:29.455995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:29.456607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:29.487591 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Getting quotas for project f7d4919e934044b7a97dce3ad1cac880. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:29.492023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Getting quotas for user b18a6ae879c14eabae7a7a6db120831a and project f7d4919e934044b7a97dce3ad1cac880. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:29.506900 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:24:29.510017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:24:29.571386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:29.572908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:29.581915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:29.582775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:29.583832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:29.584484 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:29.586570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-688cffed-07c1-49dc-8148-992554cc8cd4 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715056 Aug 04 02:24:29.587638 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 405/799] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:24:29.603245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d07e49b2-3940-4f83-9e02-834f776c397e tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:29.604931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d07e49b2-3940-4f83-9e02-834f776c397e tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:29.718810 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d07e49b2-3940-4f83-9e02-834f776c397e tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:29.726129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d07e49b2-3940-4f83-9e02-834f776c397e tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1214 microversion: 2.1 time: 0.127433 Aug 04 02:24:29.730209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 406/800] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:29 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:29.832478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:29.845792 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-44237fe4-f987-4f63-89a7-edda8cc528d7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.281517 Aug 04 02:24:29.846773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 395/801] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:29 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:29.849964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-42aa7c0e-051f-419b-a07c-b104f6fb90c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'create', calling method: .version_select at 0x7ff48f50aaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-282558098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrRJT55sMCRQA+8VS7ifmOPo40w9v3M2Xwvy950CpBjGDzpf4moYBAfzWhUbgn/MA46JnDPgpRRCYsGSnYvHC3MxVc9J8u+i5SEq94Xw0dSKEz3FK8jpf3IkDvD3PAS7g=="}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:29.869498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-42aa7c0e-051f-419b-a07c-b104f6fb90c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Getting quotas for project 06f7c91a924c447fbca1b6a784d7b167. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:29.874195 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-42aa7c0e-051f-419b-a07c-b104f6fb90c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Getting quotas for user fb3a977fea2c499eb915bc059ab01a79 and project 06f7c91a924c447fbca1b6a784d7b167. Resources: {'key_pairs'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:29.898688 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-42aa7c0e-051f-419b-a07c-b104f6fb90c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052745 Aug 04 02:24:29.899330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 407/802] 10.222.0.45 () {60 vars in 1159 bytes} [Thu Aug 4 02:24:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:30.022141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1351593828", "imageRef": "c716005c-f1bc-4b86-978c-4a32c2ee2987", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-282558098", "networks": [{"uuid": "12273cd1-fcbc-46fd-903a-fa14d59dcbe6"}]}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:30.086593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] validate_networks() for [('12273cd1-fcbc-46fd-903a-fa14d59dcbe6', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:24:30.542280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:24:30.542741 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:24:30.543219 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:24:30.543638 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:24:30.544075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:24:30.553448 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.553900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:30.554704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.555146 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:30.573322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Getting quotas for project 06f7c91a924c447fbca1b6a784d7b167. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:30.577377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Getting quotas for user fb3a977fea2c499eb915bc059ab01a79 and project 06f7c91a924c447fbca1b6a784d7b167. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:30.590204 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:24:30.592743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c716005c-f1bc-4b86-978c-4a32c2ee2987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:24:30.640521 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-57d6717b-29d4-4dae-becf-8b8bbd0a9292 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622287 Aug 04 02:24:30.641425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 396/803] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:24:30.652823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-65422261-9018-4d19-b517-b9ce3fd3c186 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:30.653439 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-65422261-9018-4d19-b517-b9ce3fd3c186 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:30.746704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:30.747329 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:30.753256 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-65422261-9018-4d19-b517-b9ce3fd3c186 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:30.761881 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.762636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:30.764351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.765133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:30.782068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-65422261-9018-4d19-b517-b9ce3fd3c186 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1258 microversion: 2.1 time: 0.133820 Aug 04 02:24:30.786778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 408/804] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:30 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1258 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:30.845785 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:30.859266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a120e9d9-17d6-411f-97a0-bdf17df8ff41 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1284 microversion: 2.1 time: 0.116944 Aug 04 02:24:30.861246 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 397/805] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:30 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:30.875161 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:30.875949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:30.883053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.883757 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:30.884905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:30.885463 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:31.044396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:31.052450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0efdde42-0d7d-4588-8540-6711b8da5601 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.181833 Aug 04 02:24:31.063435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 409/806] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:30 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:31.809131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:31.810495 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:31.820125 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:31.821225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:31.822321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:31.822936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:31.881460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:31.882736 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:31.891311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:31.892172 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:31.893189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:31.893826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:31.948606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:31.961941 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d135cf0c-0fff-4d89-8380-8adbbb5e0aec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1328 microversion: 2.1 time: 0.158641 Aug 04 02:24:31.962780 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 398/807] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:31 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:32.075639 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:32.076406 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:32.089391 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:32.089948 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:32.090831 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:32.093038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:32.105135 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:32.117980 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d83da26a-1ae9-4a84-9167-d53dc12c7941 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.236762 Aug 04 02:24:32.119103 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 410/808] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:31 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:32.314152 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:32.326528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8787edbb-bbfc-4b62-b86f-3b9577d082f3 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.254685 Aug 04 02:24:32.337470 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 399/809] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:32 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:32.660917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-adb59a4a-a162-48ca-982d-ed89630b3084 req-6d1de410-19c7-417e-943d-d8c464666816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49830900-ee39-4921-9b57-7025d31dee04", "tag": "8053474b-ee31-4379-9f91-ab7231945e67"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:32.761366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-adb59a4a-a162-48ca-982d-ed89630b3084 req-6d1de410-19c7-417e-943d-d8c464666816 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:32.762952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-adb59a4a-a162-48ca-982d-ed89630b3084 req-6d1de410-19c7-417e-943d-d8c464666816 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:32.806839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-adb59a4a-a162-48ca-982d-ed89630b3084 req-6d1de410-19c7-417e-943d-d8c464666816 service nova] Creating event network-changed:8053474b-ee31-4379-9f91-ab7231945e67 for instance 49830900-ee39-4921-9b57-7025d31dee04 on hv-cinder-74014 Aug 04 02:24:32.823493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-adb59a4a-a162-48ca-982d-ed89630b3084 req-6d1de410-19c7-417e-943d-d8c464666816 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170455 Aug 04 02:24:32.824827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 411/810] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:32.984523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:32.985993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:32.998478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.000869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.003715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.004268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.140507 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:33.141348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:33.150326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.151057 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.151999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.152644 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.274367 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:33.299621 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9a2410dd-7e4d-45b4-a9be-4e25534e0821 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.318246 Aug 04 02:24:33.302145 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 400/811] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:32 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:33.354388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:33.357233 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:33.373664 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.375467 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.377384 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:33.378268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:33.409087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:33.418111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e9f5bb5b-8bbd-455e-9d1f-49c7bce07cfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.282274 Aug 04 02:24:33.418688 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 412/812] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:33 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:33.551002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:33.559090 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-82fc521c-a64f-4a45-95dc-23601076269e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.212683 Aug 04 02:24:33.559919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 401/813] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:33 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:34.322134 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:34.322942 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:34.330380 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.330823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.331599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.332211 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.441386 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:34.442153 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:34.449539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.450175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.451202 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.451793 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.540222 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:34.562216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-75d2ccbd-7ab5-43b7-a718-393b6b9d5675 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.242805 Aug 04 02:24:34.564389 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 413/814] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:34 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:34.582603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:34.585296 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:34.601460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.602181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.603139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:34.603724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:34.697056 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:34.707360 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cb94c935-9325-4137-981a-3ecb6ff18f4b tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.270938 Aug 04 02:24:34.708211 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 402/815] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:34 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:34.776395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:34.783961 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b18ea792-3df6-48cf-a18a-5ee6e76ab04f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.208251 Aug 04 02:24:34.784524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 414/816] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:34 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:35.585060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:35.585583 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:35.592275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.592745 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.594084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.594517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.727577 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:35.728338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:35.749760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.750363 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.751246 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.751907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.755023 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:35.763555 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-fa94c8a8-8e1e-4d54-a544-38376b93d160 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.182414 Aug 04 02:24:35.773076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 403/817] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:35 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:35.803612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:35.817081 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:35.823578 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.824108 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.824993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:35.828398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:35.948099 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:35.956071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5b1f85c4-6fc1-4523-91af-445767722110 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.232596 Aug 04 02:24:35.956716 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 415/818] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:35 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:36.015694 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:36.023980 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-eec6b940-13fc-4996-8aa6-94b72b1caa8e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.224197 Aug 04 02:24:36.024544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 404/819] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:35 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:36.784539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:36.785258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:36.792678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:36.792678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:36.792918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:36.793354 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:36.934724 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:36.942918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-03d42096-cdea-4d96-a625-79a51002a9d2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.162234 Aug 04 02:24:36.943475 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 416/820] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:36 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:36.978701 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:36.979609 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:36.987786 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:36.988234 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:36.989072 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:36.989510 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:37.045897 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:37.046823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:37.055894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:37.055894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:37.055894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:37.056301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:37.181387 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:37.189258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-30888c1e-d791-4c5d-b9e3-9e1875bcf162 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.215168 Aug 04 02:24:37.198182 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 405/821] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:36 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:37.256988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:37.264687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f69fb4f2-637e-40be-af85-d885f8c2622b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.223015 Aug 04 02:24:37.265311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 417/822] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:37 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:37.963602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:37.964643 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:37.971784 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:37.972646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:37.973867 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:37.974535 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:38.133308 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:38.142313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-94e5fece-b3a9-4387-ba98-afc671413c4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.182492 Aug 04 02:24:38.143116 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 406/823] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:37 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:38.211044 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:38.211662 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:38.219514 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:38.220466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:38.221464 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:38.222071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:38.293302 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:38.293975 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:38.300246 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:38.300730 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:38.301525 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:38.301969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:38.449158 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:38.457445 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d694125b-55b8-40ed-a2f7-1da9a7e9da57 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.250139 Aug 04 02:24:38.458117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 418/824] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:38 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:38.487243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:38.496342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0a7ff8a4-d037-4d7c-91eb-5e5cdc25db9b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.208677 Aug 04 02:24:38.508018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 407/825] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:38 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:39.163117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:39.163737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:39.169895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.170345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:39.171127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.171567 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:39.307108 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:39.315755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-e5217349-057d-4188-a0f8-8acbdf40148d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.156397 Aug 04 02:24:39.316539 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 419/826] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:39 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:39.479560 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:39.480118 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:39.487317 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.487765 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:39.488528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.488991 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:39.519452 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:39.520174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:39.522187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=4 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:39.527525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.527965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:39.528766 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:39.529203 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:40.010952 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:40.018966 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1fddebc9-83c8-4e2f-9a6b-3ff07ee87a7a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.543327 Aug 04 02:24:40.019545 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 408/827] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:39 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:40.038106 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:40.046166 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-eafa9366-7b76-4db5-a4b7-d8780a78503e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.530552 Aug 04 02:24:40.047569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 420/828] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:39 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:40.336338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:40.336887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:40.342948 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:40.343420 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:40.344175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:40.344652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:40.479699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:40.487830 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-0e820476-a18b-4b10-b37e-c7d84a937e23 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.155386 Aug 04 02:24:40.488401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 409/829] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:40 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:41.039288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:41.039898 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:41.042248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=20 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:41.048366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.048851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.049615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.050055 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.069244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:41.069864 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:41.071763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:41.072445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=8 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:41.078701 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.079157 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.079941 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.080380 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.084931 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=100 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:41.236316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:41.243653 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8665ca94-a3f8-47ef-90e5-794c46cdd9b2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.208234 Aug 04 02:24:41.244223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 421/830] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:41 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:41.262376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:41.270343 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-270bb4df-1ca8-4145-8b95-af5afa6b3baf tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.205595 Aug 04 02:24:41.270913 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 410/831] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:41 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:41.508798 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:41.509442 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:41.516121 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.516571 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.517384 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:41.517807 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:41.645395 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:41.653105 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ba87c8f5-f148-4a41-9687-a0f1fddbfc68 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.148165 Aug 04 02:24:41.653683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 422/832] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:41 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:42.263446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:42.263969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:42.271095 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.271550 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.272320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.272797 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.291261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:42.291947 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:42.298504 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.298954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.299717 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.300151 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.469075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:42.473676 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:42.476866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f2eae497-1bac-4046-80d6-4f1976191919 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.217360 Aug 04 02:24:42.477478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 411/833] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:42 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:42.481425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b2e2e5d5-92cf-4a02-ba67-2bb400ff57aa tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.193972 Aug 04 02:24:42.481992 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 423/834] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:42 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:42.674342 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:42.674961 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:42.681027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.681479 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.682235 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:42.682677 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:42.892305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:42.902145 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-06f52eea-b116-4b6a-83e7-e2ca6c283961 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.231689 Aug 04 02:24:42.902726 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 412/835] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:42 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:43.372399 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-b61e6f71-a73a-4f8d-b5af-a6326e2245a6 req-5a340ba5-adab-4119-bc50-6493a5d7ef86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:43.398816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b61e6f71-a73a-4f8d-b5af-a6326e2245a6 req-5a340ba5-adab-4119-bc50-6493a5d7ef86 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.399187 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-b61e6f71-a73a-4f8d-b5af-a6326e2245a6 req-5a340ba5-adab-4119-bc50-6493a5d7ef86 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.404317 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=100 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:43.413570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-b61e6f71-a73a-4f8d-b5af-a6326e2245a6 req-5a340ba5-adab-4119-bc50-6493a5d7ef86 service nova] Creating event network-changed:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:24:43.418778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-b61e6f71-a73a-4f8d-b5af-a6326e2245a6 req-5a340ba5-adab-4119-bc50-6493a5d7ef86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050354 Aug 04 02:24:43.419666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 424/836] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:43.497345 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:43.498857 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:43.502154 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:43.503324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:43.510836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.511614 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.512598 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.513281 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.516530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.517052 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.517885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.518522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.741320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:43.744434 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:43.749114 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dd74918a-fde2-48d3-b6e8-43b41082d00e tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.251081 Aug 04 02:24:43.750328 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 425/837] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:43 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:43.752531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b33d34a5-5f6b-4e76-a0bb-5ce4b95e2daa tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.259042 Aug 04 02:24:43.753128 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 413/838] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:43 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:43.923653 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:43.924357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:43.930749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.931185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:43.932183 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:43.932590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:44.192760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:44.201817 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-82812918-4ae0-47be-86d9-6b727bc1c25d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.282166 Aug 04 02:24:44.204670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 426/839] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:43 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:44.770676 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:44.771228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:44.775768 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:44.776387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:44.777867 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:44.778357 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:44.779141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:44.779613 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:44.783343 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:44.783796 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:44.784570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:44.785037 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:44.981011 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:44.985030 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:44.988919 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b53c97ff-85e7-438a-af6d-d33c2eff8135 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.222177 Aug 04 02:24:44.989584 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 414/840] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:44 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:44.992487 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5c4ae168-8216-40f5-af6d-af2bdd29678a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.220482 Aug 04 02:24:44.993081 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 427/841] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:44 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:24:45.234600 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:45.235212 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:45.241238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:45.241688 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:45.242454 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:45.242890 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:45.481013 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:45.490278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-753ccab6-0c5d-4132-8361-9d6541cb3468 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.259360 Aug 04 02:24:45.491106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 415/842] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:45 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:46.012153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:46.012153 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:46.016947 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:46.018528 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:46.020018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.020657 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.021544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.022020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.026777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.027239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.028016 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.028756 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.231974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:46.240809 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:46.241608 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-48842b27-c61e-4b55-bcb6-1f2e841b4bac tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.235228 Aug 04 02:24:46.242267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 428/843] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:46 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:46.249253 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-56e96ac2-3d16-4698-98fc-cb85ec246a68 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.237389 Aug 04 02:24:46.260763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 416/844] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:46 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:46.358538 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-cd2a3dbf-8923-43e9-981f-cfe95bc31712 req-3285c24b-b14c-4d20-8379-f25fc7cc4291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3332bb9-b241-4099-9834-2c22f1241a44", "name": "network-vif-plugged", "status": "completed", "tag": "11df299a-5e37-4167-9de3-78f09f622f02"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:46.364575 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:46.368958 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-cd2a3dbf-8923-43e9-981f-cfe95bc31712 req-3285c24b-b14c-4d20-8379-f25fc7cc4291 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.369411 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-cd2a3dbf-8923-43e9-981f-cfe95bc31712 req-3285c24b-b14c-4d20-8379-f25fc7cc4291 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.382624 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-cd2a3dbf-8923-43e9-981f-cfe95bc31712 req-3285c24b-b14c-4d20-8379-f25fc7cc4291 service nova] Creating event network-vif-plugged:11df299a-5e37-4167-9de3-78f09f622f02 for instance b3332bb9-b241-4099-9834-2c22f1241a44 on hv-cinder-74014 Aug 04 02:24:46.387284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-cd2a3dbf-8923-43e9-981f-cfe95bc31712 req-3285c24b-b14c-4d20-8379-f25fc7cc4291 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Aug 04 02:24:46.387885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 429/845] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:46.512338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:46.513385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:46.521385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.521864 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.522936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:46.523370 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:46.729900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:46.738742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-01a79670-1e42-4452-a0d0-e0128d34fcf6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.231166 Aug 04 02:24:46.739319 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 417/846] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:46 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:47.263272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:47.263995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:47.270900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:47.271390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.271938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.272305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:47.272641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.273083 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.278937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.279473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.280334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.280872 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.467881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:47.473490 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:47.476408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c81667f7-2629-481b-aaed-b6b7bbc76c9a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1266 microversion: 2.1 time: 0.217372 Aug 04 02:24:47.477042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 430/847] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:47 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:47.481248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-340e3811-8538-47e2-8cc1-b82396db14f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.214817 Aug 04 02:24:47.481886 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 418/848] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:47 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:47.759499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:47.760109 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:47.766122 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.766574 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.767340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:47.767812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:47.897797 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:47.905215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-184abebd-0e3b-45f7-9b84-199047527d51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.149580 Aug 04 02:24:47.906417 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 431/849] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:47 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:48.425898 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "name": "network-vif-plugged", "status": "completed", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}, {"server_uuid": "49830900-ee39-4921-9b57-7025d31dee04", "name": "network-vif-plugged", "status": "completed", "tag": "8053474b-ee31-4379-9f91-ab7231945e67"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:48.439060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.439501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.451824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] Creating event network-vif-plugged:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:24:48.452383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] Creating event network-vif-plugged:8053474b-ee31-4379-9f91-ab7231945e67 for instance 49830900-ee39-4921-9b57-7025d31dee04 on hv-cinder-74014 Aug 04 02:24:48.458820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-f1036ddc-dc69-4685-a2a0-7b846421eae0 req-ab032fa9-df3b-4972-825f-8b89b14250ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038122 Aug 04 02:24:48.459403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 419/850] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:48.497682 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:48.498242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:48.502936 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:48.503701 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:48.505345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.505794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.506570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.507002 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.510268 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.512421 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.513432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.514034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.777682 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:48.786206 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b7ef3f5b-e702-4fc1-9bed-687812b3b191 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1452 microversion: 2.1 time: 0.292561 Aug 04 02:24:48.786877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 432/851] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:48 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1452 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:48.791659 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:48.799351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-788d2208-3c57-4947-bac4-658cf4b8a2d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.300569 Aug 04 02:24:48.800140 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 420/852] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:48 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:48.806345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:48.806960 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:48.813068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.813519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.814340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.814727 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.930094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:48.931248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:48.941935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.942731 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.944098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:48.944926 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:48.961547 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:48.969356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9883f222-dcb3-4de6-bb0b-11e368f456c4 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1452 microversion: 2.1 time: 0.166883 Aug 04 02:24:48.969923 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 433/853] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:48 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:49.083457 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:49.090805 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-59e7da53-7fd1-43b0-9d76-1bf6cb7b5f04 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1358 microversion: 2.1 time: 0.167971 Aug 04 02:24:49.091374 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 421/854] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:48 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:49.819428 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:49.819976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:49.826737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:49.827179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:49.828048 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:49.828525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.111600 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:50.112160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:50.113067 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:50.119148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-130027b1-8e32-4b9c-903e-2bdf686c19f9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.303620 Aug 04 02:24:50.119733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 434/855] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:49 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:50.120328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.120937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.121885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.122509 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.260336 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:50.269455 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7b306a60-48c4-400f-918e-5eaf120251df tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1549 microversion: 2.1 time: 0.161921 Aug 04 02:24:50.270027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 422/856] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:50 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:50.289326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:50.289938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:50.295896 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.296938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.297711 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.298149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.427186 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:50.436556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0ed2d963-269d-4486-8e0a-638a21183533 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1549 microversion: 2.1 time: 0.150882 Aug 04 02:24:50.437710 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 435/857] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:50 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:50.456824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:50.461611 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:50.462387 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Searching by: {'deleted': False, 'project_id': '06f7c91a924c447fbca1b6a784d7b167'} {{(pid=118167) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 02:24:50.469870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.470323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.471385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.471821 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.563572 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.multi_cell_list [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 02:24:50.658556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-29a55f1c-e1a6-4e3d-96e0-271e9042ebbe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205407 Aug 04 02:24:50.659396 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 423/858] 10.222.0.45 () {58 vars in 1125 bytes} [Thu Aug 4 02:24:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:50.670513 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:50.671208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:50.685076 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.685543 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.687054 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.687357 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.739732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-07d3bb6e-4e85-4d7d-83e5-6a73a44b49f4 req-dad628c9-f8d3-46a1-9f9e-cb0ab9c9f869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3332bb9-b241-4099-9834-2c22f1241a44", "tag": "11df299a-5e37-4167-9de3-78f09f622f02"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:50.749662 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-07d3bb6e-4e85-4d7d-83e5-6a73a44b49f4 req-dad628c9-f8d3-46a1-9f9e-cb0ab9c9f869 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:50.750107 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-07d3bb6e-4e85-4d7d-83e5-6a73a44b49f4 req-dad628c9-f8d3-46a1-9f9e-cb0ab9c9f869 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:50.761203 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-07d3bb6e-4e85-4d7d-83e5-6a73a44b49f4 req-dad628c9-f8d3-46a1-9f9e-cb0ab9c9f869 service nova] Creating event network-changed:11df299a-5e37-4167-9de3-78f09f622f02 for instance b3332bb9-b241-4099-9834-2c22f1241a44 on hv-cinder-74014 Aug 04 02:24:50.766416 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-07d3bb6e-4e85-4d7d-83e5-6a73a44b49f4 req-dad628c9-f8d3-46a1-9f9e-cb0ab9c9f869 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030250 Aug 04 02:24:50.767999 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 424/859] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:24:50.842171 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:50.851352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8d833aaa-77da-4431-88d3-a66d994d175a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1549 microversion: 2.1 time: 0.184584 Aug 04 02:24:50.851925 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 436/860] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:50 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:51.141339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:51.142110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:51.149273 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:51.149937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:51.150773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:51.151269 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:51.322226 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:51.330610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8c930ba8-0c9b-4d7c-9dfc-acb14239afec tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.194984 Aug 04 02:24:51.331188 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 425/861] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:51 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:52.351336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:52.351937 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:52.359042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:52.359494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:52.360260 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:52.360723 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:52.488366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:52.495812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d80f2e92-ca8d-4f6c-a6fe-84d28a7220de tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1314 microversion: 2.1 time: 0.148376 Aug 04 02:24:52.496362 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 437/862] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:52 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:53.482369 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d814c28-1d56-4c5a-bb93-a48070d23c05"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:53.484627 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:53.491267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:53.491714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:53.492478 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:53.492939 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:53.517787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:53.518472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:53.526207 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:53.526668 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:53.527451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:53.527895 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:53.749427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:53.755172 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:53.764049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2c839f09-2a3b-4688-854e-e66bb2e1ccfd tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1498 microversion: 2.1 time: 0.250854 Aug 04 02:24:53.764899 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 438/863] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:53 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:53.783248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-513d08dc-5fca-4a0c-b9f6-3182ae92e7f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304757 Aug 04 02:24:53.783963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 426/864] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:24:53 2022] POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:54.244145 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:54.244758 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:54.252047 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:54.252498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:54.253311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:54.253756 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:54.284607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:24:54.362498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1bc431bc-ec91-4812-990d-5e7d482cee24 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 204 len: 0 microversion: 2.1 time: 0.121662 Aug 04 02:24:54.366656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 439/865] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:24:54 2022] DELETE /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:24:54.372632 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:54.373385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:54.380258 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:54.380752 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:54.381714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:54.382158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:54.527351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:54.535332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4ca4999d-9592-4e1e-973d-a00c726839d2 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1504 microversion: 2.1 time: 0.167302 Aug 04 02:24:54.535834 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 427/866] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:54 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:55.557176 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:55.557870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:55.565360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:55.565842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:55.566615 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:55.567054 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:55.590641 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:55.719558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:55.727820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2c2b6498-0305-4f53-b15c-e59abf060d54 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1504 microversion: 2.1 time: 0.174790 Aug 04 02:24:55.728771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 440/867] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:55 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:56.298385 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-9ca93c85-97fb-4d97-927f-3a6bbef1b59a req-ecd450ce-e0c2-4372-ac9e-11f8079f1822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49830900-ee39-4921-9b57-7025d31dee04", "name": "network-vif-deleted", "tag": "8053474b-ee31-4379-9f91-ab7231945e67"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:56.303852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:56.309607 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9ca93c85-97fb-4d97-927f-3a6bbef1b59a req-ecd450ce-e0c2-4372-ac9e-11f8079f1822 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:56.310048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9ca93c85-97fb-4d97-927f-3a6bbef1b59a req-ecd450ce-e0c2-4372-ac9e-11f8079f1822 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:56.321944 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-9ca93c85-97fb-4d97-927f-3a6bbef1b59a req-ecd450ce-e0c2-4372-ac9e-11f8079f1822 service nova] Creating event network-vif-deleted:8053474b-ee31-4379-9f91-ab7231945e67 for instance 49830900-ee39-4921-9b57-7025d31dee04 on hv-cinder-74014 Aug 04 02:24:56.327224 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-9ca93c85-97fb-4d97-927f-3a6bbef1b59a req-ecd450ce-e0c2-4372-ac9e-11f8079f1822 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032763 Aug 04 02:24:56.328030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 428/868] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:24:56.749948 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:56.750581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:56.759271 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:56.760326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:56.761299 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:56.761920 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:56.802919 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:56.803365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:56.803976 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lazy-loading 'fault' on Instance uuid 49830900-ee39-4921-9b57-7025d31dee04 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:24:56.849715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:56.856610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-865a3b0b-a560-4e02-a377-8bb843e4a332 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 200 len: 1304 microversion: 2.1 time: 0.111151 Aug 04 02:24:56.857226 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 441/869] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:56 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:57.879485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:57.880186 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 49830900-ee39-4921-9b57-7025d31dee04] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:57.886457 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:57.887047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:57.887682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:57.888119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:57.903368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] HTTP exception thrown: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Request method failure captured: Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 HTTP/1.1 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y3a6jAVodxkZ2MGpiQSUQgGCNuk8P9RxYL8FKiOXw3YxmFQ78NGKkJD0PTzOuMKlf6HRFiSwesimJ4bvhHQdMLnF-18L01W2pXRbbi-ErGD7rgMLLQOi8mg2B8ikLFDt0bEj5O0CAB-d0MvkEMvGbixWQiK-WUEUpGVCjWrxDYUTpk Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: f7d4919e934044b7a97dce3ad1cac880 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesActionsTest-1431066473 Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:24:57.905288 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesActionsTest-1431066473 Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: f7d4919e934044b7a97dce3ad1cac880 Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesActionsTest-1431066473 Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesActionsTest-1431066473-project Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: b18a6ae879c14eabae7a7a6db120831a Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesActionsTest-1431066473-project Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. Aug 04 02:24:57.907028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '49830900-ee39-4921-9b57-7025d31dee04'} Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:24:57.908077 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. Aug 04 02:24:57.909724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:24:57.911141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Returning 404 to user: Instance 49830900-ee39-4921-9b57-7025d31dee04 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:24:57.911141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f99d825d-f243-4e3c-9da7-d9d34e935e5a tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04" status: 404 len: 111 microversion: 2.1 time: 0.033427 Aug 04 02:24:57.911141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 429/870] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:57 2022] GET /compute/v2.1/servers/49830900-ee39-4921-9b57-7025d31dee04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:24:58.014453 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1442512860", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "networks": [{"uuid": "82033b8a-fd6f-44a1-9a32-4b4326d62bc3"}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:24:58.078458 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] validate_networks() for [('82033b8a-fd6f-44a1-9a32-4b4326d62bc3', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:24:58.441712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:24:58.442218 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:24:58.442833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:24:58.443317 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:24:58.443803 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:24:58.452664 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:58.453231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:58.453914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:58.454851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:58.472822 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Getting quotas for project f7d4919e934044b7a97dce3ad1cac880. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:24:58.476869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Getting quotas for user b18a6ae879c14eabae7a7a6db120831a and project f7d4919e934044b7a97dce3ad1cac880. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:24:58.490770 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:24:58.493143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:24:58.540322 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-53a73961-d791-4735-b0e5-f4259a2265a8 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530392 Aug 04 02:24:58.541251 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 442/871] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:24:58.552313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cd6fdbcb-f811-48d9-a9c4-3cede19af831 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:58.553040 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-cd6fdbcb-f811-48d9-a9c4-3cede19af831 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:58.626843 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-cd6fdbcb-f811-48d9-a9c4-3cede19af831 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:58.634225 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cd6fdbcb-f811-48d9-a9c4-3cede19af831 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1214 microversion: 2.1 time: 0.086232 Aug 04 02:24:58.634996 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 430/872] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:58 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:24:59.655100 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:24:59.655709 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:24:59.662997 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:59.663447 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:59.664213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:24:59.664675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:24:59.726448 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:24:59.733779 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-28bf9322-a5d3-4425-92cc-91ff13988ea9 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1274 microversion: 2.1 time: 0.083026 Aug 04 02:24:59.734334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 443/873] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:24:59 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:00.754597 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:00.755265 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:00.757925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:00.764049 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:00.764510 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:00.765285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:00.765744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:00.834105 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:00.841542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c00a1278-a900-4f61-b87b-bd9f159b3220 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1272 microversion: 2.1 time: 0.090856 Aug 04 02:25:00.842113 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 431/874] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:00 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:01.447123 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:01.447737 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:01.454846 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:01.460111 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:01.461104 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:01.461674 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:01.648156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:01.662777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-077130a2-702b-46ef-98dd-e3100bb9b0d8 req-1f4eb2eb-d952-4b69-a4c2-f0176f0686e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70015cf8-e589-4b29-bf9b-10d0af398435", "tag": "d50ccd06-84d7-412b-b300-4a84d3b0dac4"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:01.668363 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-7d44a3c8-dcd2-43bd-be12-11a39ff2a479 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1595 microversion: 2.1 time: 0.230159 Aug 04 02:25:01.669072 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 444/875] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:01 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1595 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:01.691213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-077130a2-702b-46ef-98dd-e3100bb9b0d8 req-1f4eb2eb-d952-4b69-a4c2-f0176f0686e7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:01.692012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-077130a2-702b-46ef-98dd-e3100bb9b0d8 req-1f4eb2eb-d952-4b69-a4c2-f0176f0686e7 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:01.704231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-077130a2-702b-46ef-98dd-e3100bb9b0d8 req-1f4eb2eb-d952-4b69-a4c2-f0176f0686e7 service nova] Creating event network-changed:d50ccd06-84d7-412b-b300-4a84d3b0dac4 for instance 70015cf8-e589-4b29-bf9b-10d0af398435 on hv-cinder-74014 Aug 04 02:25:01.709609 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-077130a2-702b-46ef-98dd-e3100bb9b0d8 req-1f4eb2eb-d952-4b69-a4c2-f0176f0686e7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056021 Aug 04 02:25:01.710212 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 432/876] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:25:01.863828 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:01.864436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:01.870508 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:01.870965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:01.871746 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:01.872189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:02.104053 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:02.112435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-cb30fbec-1b93-4e41-8175-3a1a09769776 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1314 microversion: 2.1 time: 0.252985 Aug 04 02:25:02.113138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 445/877] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:01 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:03.135486 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:03.136352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:03.143878 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:03.144348 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:03.145158 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:03.145785 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:03.391852 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:03.399819 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8e5fbd1f-3e79-4d22-96df-50537e0a5528 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1314 microversion: 2.1 time: 0.269121 Aug 04 02:25:03.400400 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 433/878] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:03 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:03.751138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-6dd6ae43-ebb7-4524-8d8d-61d34a39b2fe req-31c95b9b-f04b-4318-9117-695aa9433a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:03.762364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-6dd6ae43-ebb7-4524-8d8d-61d34a39b2fe req-31c95b9b-f04b-4318-9117-695aa9433a06 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:03.762971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-6dd6ae43-ebb7-4524-8d8d-61d34a39b2fe req-31c95b9b-f04b-4318-9117-695aa9433a06 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:03.777816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-6dd6ae43-ebb7-4524-8d8d-61d34a39b2fe req-31c95b9b-f04b-4318-9117-695aa9433a06 service nova] Creating event network-changed:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:25:03.783739 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-6dd6ae43-ebb7-4524-8d8d-61d34a39b2fe req-31c95b9b-f04b-4318-9117-695aa9433a06 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036568 Aug 04 02:25:03.784441 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 446/879] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:04.426180 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:04.426880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:04.448473 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:04.449299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:04.450110 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:04.450553 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:04.724848 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:04.736888 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a1c806e7-f2ec-46f3-a24d-6fc41c6c2138 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1314 microversion: 2.1 time: 0.319281 Aug 04 02:25:04.737777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 434/880] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:04 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:05.273315 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1807805979"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:05.274525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:05.286457 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.287072 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.287683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.289534 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.435174 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.network.security_group_api [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Adding security group 88174330-137d-45cf-91a0-6fbf482d4048 to port 92139371-2e53-454b-9e82-e159aac502fd Aug 04 02:25:05.757264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f68f6c78-3b4a-47af-8bcf-411324acdc4b tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.488704 Aug 04 02:25:05.757860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 447/881] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:25:05 2022] POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:25:05.761407 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:05.762025 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:05.767751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:05.768290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:05.769372 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.770010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.771001 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.771632 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.776665 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.777373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.779320 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:05.779972 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:05.994542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:06.002354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-55873867-e7fc-4350-8fff-fafdda37e61d tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1314 microversion: 2.1 time: 0.244877 Aug 04 02:25:06.003113 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 435/882] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:05 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:25:06.004238 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:06.009884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-a1d62e0c-f175-431d-b20c-7f438af81239 req-d1956ba0-a9e1-48d9-a882-5c3c22e98652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:06.013755 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9b339141-0fe6-4767-9300-d77180af13ec tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1760 microversion: 2.1 time: 0.251679 Aug 04 02:25:06.021355 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a1d62e0c-f175-431d-b20c-7f438af81239 req-d1956ba0-a9e1-48d9-a882-5c3c22e98652 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:06.022057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-a1d62e0c-f175-431d-b20c-7f438af81239 req-d1956ba0-a9e1-48d9-a882-5c3c22e98652 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:06.027550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 448/883] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:05 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1760 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:25:06.035657 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-a1d62e0c-f175-431d-b20c-7f438af81239 req-d1956ba0-a9e1-48d9-a882-5c3c22e98652 service nova] Creating event network-changed:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:25:06.040782 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-a1d62e0c-f175-431d-b20c-7f438af81239 req-d1956ba0-a9e1-48d9-a882-5c3c22e98652 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036202 Aug 04 02:25:06.041376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 436/884] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:06.508358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-bed93c85-876a-4d96-9f87-f9aca27b9054 req-a683518a-b6b1-4820-a281-83642101aa8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70015cf8-e589-4b29-bf9b-10d0af398435", "name": "network-vif-plugged", "status": "completed", "tag": "d50ccd06-84d7-412b-b300-4a84d3b0dac4"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:06.525135 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-bed93c85-876a-4d96-9f87-f9aca27b9054 req-a683518a-b6b1-4820-a281-83642101aa8c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:06.525978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-bed93c85-876a-4d96-9f87-f9aca27b9054 req-a683518a-b6b1-4820-a281-83642101aa8c service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:06.544150 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-bed93c85-876a-4d96-9f87-f9aca27b9054 req-a683518a-b6b1-4820-a281-83642101aa8c service nova] Creating event network-vif-plugged:d50ccd06-84d7-412b-b300-4a84d3b0dac4 for instance 70015cf8-e589-4b29-bf9b-10d0af398435 on hv-cinder-74014 Aug 04 02:25:06.552460 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-bed93c85-876a-4d96-9f87-f9aca27b9054 req-a683518a-b6b1-4820-a281-83642101aa8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049591 Aug 04 02:25:06.555332 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 449/885] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:07.025686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:07.026368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:07.033121 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:07.033593 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:07.034772 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:07.035207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:07.180606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:07.189678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2af1d038-b5e7-4d3d-bf50-14afc95150fc tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1314 microversion: 2.1 time: 0.168808 Aug 04 02:25:07.190281 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 437/886] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:07 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:08.210765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:08.211639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:08.218141 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:08.218767 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:08.219813 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:08.220340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:08.363790 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:08.371623 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-29973896-d309-43d4-8dec-c57329308ef6 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1498 microversion: 2.1 time: 0.165584 Aug 04 02:25:08.372188 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 450/887] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:08 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:08.888549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:08.889390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:08.893769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:08.903654 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:08.904201 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:08.905115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:08.905746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:08.951775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:25:09.046475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8f03165a-1715-4fb7-9213-b36737544b16 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "DELETE /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 204 len: 0 microversion: 2.1 time: 0.164702 Aug 04 02:25:09.047765 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 438/888] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:25:08 2022] DELETE /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:25:09.055959 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:09.056566 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:09.058541 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:09.059330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:09.065874 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:09.066628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:09.067105 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:09.067553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:09.204200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:09.211988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-460dde48-1e20-4d50-bcd2-ef6005c7c437 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1504 microversion: 2.1 time: 0.159763 Aug 04 02:25:09.212697 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 451/889] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:09 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:10.234167 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:10.235552 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:10.242646 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:10.243149 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:10.243987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:10.244493 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:10.385575 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:10.393570 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6ca46ffc-b4b9-424d-aa29-7fed852c0116 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1504 microversion: 2.1 time: 0.163774 Aug 04 02:25:10.394136 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 439/890] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:10 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:11.181117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-ad346db5-e450-402a-ae7f-692293eeadc9 req-0fd088d4-6bc8-4c89-bebb-683aa6145a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70015cf8-e589-4b29-bf9b-10d0af398435", "name": "network-vif-deleted", "tag": "d50ccd06-84d7-412b-b300-4a84d3b0dac4"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:11.192160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ad346db5-e450-402a-ae7f-692293eeadc9 req-0fd088d4-6bc8-4c89-bebb-683aa6145a79 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:11.192606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-ad346db5-e450-402a-ae7f-692293eeadc9 req-0fd088d4-6bc8-4c89-bebb-683aa6145a79 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:11.205078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-ad346db5-e450-402a-ae7f-692293eeadc9 req-0fd088d4-6bc8-4c89-bebb-683aa6145a79 service nova] Creating event network-vif-deleted:d50ccd06-84d7-412b-b300-4a84d3b0dac4 for instance 70015cf8-e589-4b29-bf9b-10d0af398435 on hv-cinder-74014 Aug 04 02:25:11.210253 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-ad346db5-e450-402a-ae7f-692293eeadc9 req-0fd088d4-6bc8-4c89-bebb-683aa6145a79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033153 Aug 04 02:25:11.211054 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 452/891] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:11.414573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:11.415208 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:11.422826 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:11.423274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:11.424029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:11.424453 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:11.456435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:11.456915 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:11.457356 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lazy-loading 'fault' on Instance uuid 70015cf8-e589-4b29-bf9b-10d0af398435 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:25:11.501162 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18a6ae879c14eabae7a7a6db120831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d4919e934044b7a97dce3ad1cac880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:11.508577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-01af0d33-220a-4361-9c1e-dc88f491f9b3 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 200 len: 1304 microversion: 2.1 time: 0.097898 Aug 04 02:25:11.509170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 440/892] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:11 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:12.530998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:12.532387 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] [instance: 70015cf8-e589-4b29-bf9b-10d0af398435] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:12.538546 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:12.538993 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:12.539752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:12.540190 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:12.553338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] HTTP exception thrown: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Request method failure captured: Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 HTTP/1.1 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y3a6jAVodxkZ2MGpiQSUQgGCNuk8P9RxYL8FKiOXw3YxmFQ78NGKkJD0PTzOuMKlf6HRFiSwesimJ4bvhHQdMLnF-18L01W2pXRbbi-ErGD7rgMLLQOi8mg2B8ikLFDt0bEj5O0CAB-d0MvkEMvGbixWQiK-WUEUpGVCjWrxDYUTpk Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: f7d4919e934044b7a97dce3ad1cac880 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-VolumesActionsTest-1431066473 Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:25:12.554952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f7d4919e934044b7a97dce3ad1cac880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-VolumesActionsTest-1431066473 Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: f7d4919e934044b7a97dce3ad1cac880 Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-VolumesActionsTest-1431066473 Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-VolumesActionsTest-1431066473-project Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: b18a6ae879c14eabae7a7a6db120831a Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-VolumesActionsTest-1431066473-project Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. Aug 04 02:25:12.556690 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '70015cf8-e589-4b29-bf9b-10d0af398435'} Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:25:12.557829 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. Aug 04 02:25:12.559478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:25:12.560940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] Returning 404 to user: Instance 70015cf8-e589-4b29-bf9b-10d0af398435 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:25:12.560940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6edb3db9-42df-4ce6-aebc-573e4cb08d87 tempest-VolumesActionsTest-1431066473 tempest-VolumesActionsTest-1431066473-project] 10.222.0.45 "GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435" status: 404 len: 111 microversion: 2.1 time: 0.030571 Aug 04 02:25:12.560940 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 453/893] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:12 2022] GET /compute/v2.1/servers/70015cf8-e589-4b29-bf9b-10d0af398435 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:25:31.428297 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:31.434630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:31.441219 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:31.442115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:31.457352 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:31.457817 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:31.458620 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:31.459069 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:31.730887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6491cc02-79c2-4def-83f9-b128ffec8abc tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.306344 Aug 04 02:25:31.736773 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 441/894] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:25:31 2022] POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:25:31.740381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:31.741007 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:31.744388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:31.745477 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=60 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:31.749663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:31.750348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:31.751486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:31.752215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:32.062661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:32.072407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9ecaddeb-e4fd-4450-a7e8-c9e8da61c16d tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1752 microversion: 2.1 time: 0.336352 Aug 04 02:25:32.073001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 454/895] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:31 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1752 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:33.095430 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:33.096285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:33.103221 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:33.103803 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:33.104724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:33.105266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:33.293054 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:33.302115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-748299d2-b8b5-4ea5-a630-9ced102815aa tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.211888 Aug 04 02:25:33.302706 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 442/896] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:33 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:34.327264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:34.327783 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:34.335216 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:34.335671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:34.336451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:34.336918 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:34.495401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:34.503906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d2f34195-29c5-4f30-a509-9951ea8b8313 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.180614 Aug 04 02:25:34.504485 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 455/897] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:34 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:35.527866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:35.528994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:35.537228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:35.537686 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:35.538458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:35.538899 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:35.700776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:35.708845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-9d253946-0d50-40a4-8dbb-fee15034699a tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.186792 Aug 04 02:25:35.709397 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 443/898] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:35 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:36.730343 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:36.731178 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:36.738906 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:36.739366 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:36.740225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:36.740689 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:37.045084 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:37.054273 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-595871b5-ee9a-4825-b87e-bb9157cbac61 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.327839 Aug 04 02:25:37.054951 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 456/899] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:36 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:38.080950 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:38.081971 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:38.090252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:38.090842 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:38.091682 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:38.092405 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:38.259460 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:38.269027 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d35eb10e-7154-4462-a9f2-b98c525007d1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.194525 Aug 04 02:25:38.270403 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 444/900] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:38 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:39.295784 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:39.298255 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:39.306788 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:39.307505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:39.308651 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:39.309238 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:39.495359 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:39.504294 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0cf910bf-fbb0-43b1-83f5-672aa8baffff tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.213703 Aug 04 02:25:39.505102 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 457/901] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:39 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:40.525876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:40.526520 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:40.533832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:40.534286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:40.535120 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:40.535497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:40.683776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:40.692171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5ef2a82d-a699-4d99-8e9e-288d618f0104 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.170179 Aug 04 02:25:40.692748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 445/902] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:40 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:41.179386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1823244299", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "networks": [{"uuid": "63632897-cfd5-41e9-875a-d724156cb8a5"}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:41.233729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] validate_networks() for [('63632897-cfd5-41e9-875a-d724156cb8a5', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:25:41.584200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:25:41.584611 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:25:41.585129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:25:41.585529 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:25:41.585933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:25:41.595316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:41.595802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:41.596585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:41.597033 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:41.613998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Getting quotas for project b8fd26658f57474aba12bceb6b9c7176. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:25:41.617754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Getting quotas for user ccc39daa4b074ddeb97755f1b1535f50 and project b8fd26658f57474aba12bceb6b9c7176. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:25:41.628352 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:25:41.630608 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:25:41.675242 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a6e1cd3e-1a3f-4c71-9c52-0ed1fc0b0b47 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499564 Aug 04 02:25:41.675899 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 458/903] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:25:41.686604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-2f29993a-bed0-45d7-90fb-ccef43f92162 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:41.687318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-2f29993a-bed0-45d7-90fb-ccef43f92162 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:41.713452 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:41.714189 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:41.721451 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:41.721981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:41.722863 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:41.723377 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:41.745732 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-2f29993a-bed0-45d7-90fb-ccef43f92162 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:41.753231 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-2f29993a-bed0-45d7-90fb-ccef43f92162 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1219 microversion: 2.1 time: 0.070565 Aug 04 02:25:41.753880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 446/904] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:41 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:41.889665 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:41.898557 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ee08f470-7f92-4175-9bcd-e1503ec25710 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.189029 Aug 04 02:25:41.899225 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 459/905] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:41 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:25:42.774700 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:42.775254 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:42.785182 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:42.785724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:42.786975 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:42.787541 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:42.861564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:42.869150 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c10f4004-c98e-43be-9e5d-975e86cfdb0e tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1277 microversion: 2.1 time: 0.098774 Aug 04 02:25:42.869747 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 447/906] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:42 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:42.921211 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:42.923308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:42.929983 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:42.930413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:42.931200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:42.931671 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:43.146017 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:43.154330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5d325ecb-0f0a-474d-995b-ebab5b8e9411 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.237052 Aug 04 02:25:43.154914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 460/907] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:42 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:43.891360 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:43.892002 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:43.898708 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:43.899840 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:43.900577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:43.901046 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:44.066414 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-0b8c1651-e70f-42f5-b526-ee56e1655601 req-13175564-18e9-40d1-87cd-8a07f795e7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d121270-00a5-4d73-a0e1-81b4a4778120", "tag": "3d06ec85-4434-4f4d-b656-178bf4bdd378"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:44.078425 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0b8c1651-e70f-42f5-b526-ee56e1655601 req-13175564-18e9-40d1-87cd-8a07f795e7bf service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:44.079006 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-0b8c1651-e70f-42f5-b526-ee56e1655601 req-13175564-18e9-40d1-87cd-8a07f795e7bf service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:44.091410 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-0b8c1651-e70f-42f5-b526-ee56e1655601 req-13175564-18e9-40d1-87cd-8a07f795e7bf service nova] Creating event network-changed:3d06ec85-4434-4f4d-b656-178bf4bdd378 for instance 9d121270-00a5-4d73-a0e1-81b4a4778120 on hv-cinder-74014 Aug 04 02:25:44.096938 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-0b8c1651-e70f-42f5-b526-ee56e1655601 req-13175564-18e9-40d1-87cd-8a07f795e7bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 Aug 04 02:25:44.097858 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 461/908] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:44.100287 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:44.107909 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-827a51ed-5bc3-41f1-a001-b997e8ce7f3a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.221163 Aug 04 02:25:44.108561 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 448/909] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:43 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:44.176518 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:44.177215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:44.183585 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:44.184041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:44.184848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:44.185293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:44.407446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:44.417069 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-00dd1148-e937-4916-aeef-7dbd11cde4e2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.245276 Aug 04 02:25:44.417661 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 462/910] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:44 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:45.129292 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:45.129888 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:45.136377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:45.136850 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:45.137618 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:45.138050 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:45.265242 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:45.273884 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-317cb0de-2b6e-412d-80cf-5d9a86442df1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.148835 Aug 04 02:25:45.283907 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 449/911] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:45 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:45.442795 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:45.443419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:45.450128 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:45.450583 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:45.451365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:45.451804 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:45.696371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:45.704569 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-859f1952-90a0-4e0e-8331-f08a239e70fe tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.267488 Aug 04 02:25:45.705173 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 463/912] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:45 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:46.294368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:46.294995 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:46.301502 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:46.301955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:46.302737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:46.303174 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:46.445023 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:46.453516 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4d6c2df2-417d-41ba-b2ac-ac2a4f094a77 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.162416 Aug 04 02:25:46.454101 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 450/913] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:46 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:46.725231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:46.725775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:46.732556 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:46.733038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:46.733824 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:46.734268 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:46.878471 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:46.886420 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-babf700e-1980-4e8d-9bd9-3708b1bed6c1 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.165128 Aug 04 02:25:46.886974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 464/914] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:46 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:47.474580 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:47.475195 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:47.481714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:47.482168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:47.482937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:47.483379 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:47.613770 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:47.621189 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5b3ae997-9d57-4f97-b6a7-99f313c93c1d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.150494 Aug 04 02:25:47.621755 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 451/915] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:47 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:47.907385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:47.907986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:47.914466 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:47.914913 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:47.915738 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:47.916147 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:48.059272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:48.067884 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-ca86d0bf-ed94-45b2-b048-494998094168 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1757 microversion: 2.1 time: 0.164360 Aug 04 02:25:48.068450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 465/916] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:47 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:48.376314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-2d6638d4-7ab3-4963-9ed2-6dbb6af93775 req-14572bf0-c357-4b6f-8bab-e84d05daccac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d121270-00a5-4d73-a0e1-81b4a4778120", "name": "network-vif-plugged", "status": "completed", "tag": "3d06ec85-4434-4f4d-b656-178bf4bdd378"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:25:48.386076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-2d6638d4-7ab3-4963-9ed2-6dbb6af93775 req-14572bf0-c357-4b6f-8bab-e84d05daccac service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:48.386487 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-2d6638d4-7ab3-4963-9ed2-6dbb6af93775 req-14572bf0-c357-4b6f-8bab-e84d05daccac service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:48.397397 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-2d6638d4-7ab3-4963-9ed2-6dbb6af93775 req-14572bf0-c357-4b6f-8bab-e84d05daccac service nova] Creating event network-vif-plugged:3d06ec85-4434-4f4d-b656-178bf4bdd378 for instance 9d121270-00a5-4d73-a0e1-81b4a4778120 on hv-cinder-74014 Aug 04 02:25:48.402692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-2d6638d4-7ab3-4963-9ed2-6dbb6af93775 req-14572bf0-c357-4b6f-8bab-e84d05daccac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Aug 04 02:25:48.403314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 452/917] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:25:48.641496 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:48.642109 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:48.648386 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:48.648870 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:48.649655 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:48.650094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:48.847390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:48.854836 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0420641b-191d-478c-b7be-e8ecd1afff6d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.217861 Aug 04 02:25:48.855412 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 466/918] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:48 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:49.089892 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:49.090538 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:49.097637 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:49.098084 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:49.098835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:49.099267 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:49.243425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:49.251318 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4337a905-96fc-4ce8-8671-4339958afcf2 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1760 microversion: 2.1 time: 0.166288 Aug 04 02:25:49.251880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 453/919] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:49 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:49.876553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:49.877261 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:49.883708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:49.884161 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:49.884966 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:49.885405 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:50.012116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:50.019537 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-60c35406-149a-4d8b-8b2e-c6ecf946db07 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1319 microversion: 2.1 time: 0.147381 Aug 04 02:25:50.020103 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 467/920] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:49 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:25:51.039775 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:25:51.040368 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:25:51.047115 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:51.047567 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:51.048331 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:25:51.048800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:25:51.180122 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:25:51.188214 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-dbf44a25-6dcf-4b34-8f93-b5ec32609faf tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1507 microversion: 2.1 time: 0.152374 Aug 04 02:25:51.188798 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 454/921] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:25:51 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:06.352561 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "040c1cf5-c9d8-4f3d-8799-5e98402de268", "device": "/dev/sdb"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:06.355536 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:06.357684 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:06.358338 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:06.359098 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:06.359745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=76 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:06.366413 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:06.366865 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:06.367643 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:06.368085 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:06.603894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-65aabaa6-d5a6-4e12-a669-13ef381ae03a tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "POST /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255084 Aug 04 02:26:06.604505 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 468/922] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:26:06 2022] POST /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:29.279968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:29.280836 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:29.284523 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:29.285977 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=30 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:29.286303 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:29.292739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:29.293196 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:29.293981 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:29.294421 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:29.378707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lazy-loading 'services' on Instance uuid 9d121270-00a5-4d73-a0e1-81b4a4778120 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:26:29.451305 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b7d4c6d2-9873-41e3-af9e-5f61cd98890d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120/os-volume_attachments/040c1cf5-c9d8-4f3d-8799-5e98402de268" status: 202 len: 0 microversion: 2.1 time: 0.176172 Aug 04 02:26:29.452194 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 455/923] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:26:29 2022] DELETE /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120/os-volume_attachments/040c1cf5-c9d8-4f3d-8799-5e98402de268 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:26:30.570469 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:30.571235 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:30.576040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:30.576639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:30.584995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:30.585448 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:30.586218 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:30.586656 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:30.613024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:26:30.689766 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c2aa7ce3-7bd2-4fb8-9028-5389d6344f6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 204 len: 0 microversion: 2.1 time: 0.120524 Aug 04 02:26:30.690360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 469/924] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:26:30 2022] DELETE /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:26:30.700307 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:30.701170 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:30.707846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:30.708300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:30.709122 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:30.709564 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:30.838903 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:30.846620 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d956d4a4-1bc0-4cb6-bdb9-2bdcbb1950ad tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1513 microversion: 2.1 time: 0.151149 Aug 04 02:26:30.847431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 456/925] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:30 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:31.867639 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:31.868373 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:31.874853 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:31.875309 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:31.876077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:31.876516 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:32.007258 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:32.014722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0efacdf4-4bad-4f67-98ee-a3352736091d tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1513 microversion: 2.1 time: 0.151371 Aug 04 02:26:32.015294 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 470/926] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:31 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:32.823616 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-be3e7a6b-d54f-4d5c-a78d-2aba4d968058 req-57b77e77-f4ff-4e16-99ab-62222858201d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d121270-00a5-4d73-a0e1-81b4a4778120", "name": "network-vif-deleted", "tag": "3d06ec85-4434-4f4d-b656-178bf4bdd378"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:32.834198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-be3e7a6b-d54f-4d5c-a78d-2aba4d968058 req-57b77e77-f4ff-4e16-99ab-62222858201d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:32.834679 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-be3e7a6b-d54f-4d5c-a78d-2aba4d968058 req-57b77e77-f4ff-4e16-99ab-62222858201d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:32.846699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-be3e7a6b-d54f-4d5c-a78d-2aba4d968058 req-57b77e77-f4ff-4e16-99ab-62222858201d service nova] Creating event network-vif-deleted:3d06ec85-4434-4f4d-b656-178bf4bdd378 for instance 9d121270-00a5-4d73-a0e1-81b4a4778120 on hv-cinder-74014 Aug 04 02:26:32.851692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-be3e7a6b-d54f-4d5c-a78d-2aba4d968058 req-57b77e77-f4ff-4e16-99ab-62222858201d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Aug 04 02:26:32.852462 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 457/927] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:33.036035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:33.036596 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:33.043296 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:33.043751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:33.044530 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:33.045003 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:33.077850 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:33.078303 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:33.078752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.objects.instance [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lazy-loading 'fault' on Instance uuid 9d121270-00a5-4d73-a0e1-81b4a4778120 {{(pid=118168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:26:33.122725 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:33.130667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2d620506-fd26-4b4b-b721-5e82fab413d1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 200 len: 1309 microversion: 2.1 time: 0.099161 Aug 04 02:26:33.131233 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 471/928] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:33 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:34.151937 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:34.152714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: 9d121270-00a5-4d73-a0e1-81b4a4778120] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:34.159096 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:34.159539 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:34.160291 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:34.160754 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:34.173658 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] HTTP exception thrown: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Request method failure captured: Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 HTTP/1.1 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y4jk53kxVKvoVvF6X-0EuiXF3LMMLgZsfv30LNiezCaT34Kz9PfUM0DLoFHFrgfZ8faQx5IG20-jKSoHvnJU9A-muWZjzCMu3-oZ_KSJ0lfZsmV6YP0Tn3oC4nH9v6qZne0C1m-cGJ5CzBl4tbNkqL_r_BqI5wrfyoEOfzki7yZCic Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: b8fd26658f57474aba12bceb6b9c7176 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:26:34.175791 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: b8fd26658f57474aba12bceb6b9c7176 Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesSnapshotTestJSON-1790777867-project Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: ccc39daa4b074ddeb97755f1b1535f50 Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesSnapshotTestJSON-1790777867-project Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. Aug 04 02:26:34.177606 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': '9d121270-00a5-4d73-a0e1-81b4a4778120'} Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:26:34.178626 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. Aug 04 02:26:34.179983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:26:34.181228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Returning 404 to user: Instance 9d121270-00a5-4d73-a0e1-81b4a4778120 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:26:34.181228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ee16defc-7a13-4608-a829-1bd24cd0e284 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120" status: 404 len: 111 microversion: 2.1 time: 0.029899 Aug 04 02:26:34.181228 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 458/929] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:34 2022] GET /compute/v2.1/servers/9d121270-00a5-4d73-a0e1-81b4a4778120 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:26:41.954873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1705568461", "imageRef": "b91232ff-ee3a-4d22-ad5a-2deef6a90e7e", "flavorRef": "452", "networks": [{"uuid": "63632897-cfd5-41e9-875a-d724156cb8a5"}]}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:42.009161 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.network.neutron [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] validate_networks() for [('63632897-cfd5-41e9-875a-d724156cb8a5', None, None, None, None, None)] {{(pid=118168) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:26:42.350830 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Flavor limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:26:42.351308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Image limits 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:26:42.351787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Flavor pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:26:42.352223 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Image pref 0:0:0 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:26:42.352722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.virt.hardware [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:26:42.362108 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:42.362559 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:42.363364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:42.363805 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:42.380921 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Getting quotas for project b8fd26658f57474aba12bceb6b9c7176. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:26:42.384898 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.quota [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Getting quotas for user ccc39daa4b074ddeb97755f1b1535f50 and project b8fd26658f57474aba12bceb6b9c7176. Resources: {'instances', 'ram', 'cores'} {{(pid=118168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:26:42.396009 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Going to run 1 instances... {{(pid=118168) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:26:42.399325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b91232ff-ee3a-4d22-ad5a-2deef6a90e7e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:26:42.455728 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1308a028-efe5-469f-b290-0192edc2c2c1 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504607 Aug 04 02:26:42.456385 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 472/930] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:26:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:26:42.467448 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-efff8ec4-d1d4-4c5a-a8cc-19922c763389 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:42.468041 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-efff8ec4-d1d4-4c5a-a8cc-19922c763389 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:42.523987 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-efff8ec4-d1d4-4c5a-a8cc-19922c763389 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:42.530748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-efff8ec4-d1d4-4c5a-a8cc-19922c763389 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1219 microversion: 2.1 time: 0.067286 Aug 04 02:26:42.531238 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 459/931] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:42 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:43.550965 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:43.552139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:43.558299 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:43.558855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:43.559683 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:43.560192 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:43.637279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:43.645495 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-d2e9427b-b132-46d1-bca1-77b56420c2b7 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1277 microversion: 2.1 time: 0.099117 Aug 04 02:26:43.656956 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 473/932] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:43 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:44.625900 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-23cfbd4f-4577-4dac-9361-e1ce63f4141b req-73820d33-051f-4475-adf7-793af470b885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc4043cf-ce9f-4a41-bd25-194e27776986", "tag": "324a1895-e679-4f2c-89b8-1cdd563d2bea"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:44.632983 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:44.638751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-23cfbd4f-4577-4dac-9361-e1ce63f4141b req-73820d33-051f-4475-adf7-793af470b885 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:44.639199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-23cfbd4f-4577-4dac-9361-e1ce63f4141b req-73820d33-051f-4475-adf7-793af470b885 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:44.651871 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-23cfbd4f-4577-4dac-9361-e1ce63f4141b req-73820d33-051f-4475-adf7-793af470b885 service nova] Creating event network-changed:324a1895-e679-4f2c-89b8-1cdd563d2bea for instance bc4043cf-ce9f-4a41-bd25-194e27776986 on hv-cinder-74014 Aug 04 02:26:44.659911 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-23cfbd4f-4577-4dac-9361-e1ce63f4141b req-73820d33-051f-4475-adf7-793af470b885 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037693 Aug 04 02:26:44.661436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 460/933] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:44.667760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:44.668371 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:44.675679 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:44.676136 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:44.676952 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:44.677500 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:44.893139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:44.900449 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-be833ec0-464f-4832-9630-a7f20e825e89 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.236608 Aug 04 02:26:44.901034 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 474/934] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:44 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:45.922286 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:45.923333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:45.930446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:45.930929 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:45.931707 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:45.932143 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:46.143661 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:46.151632 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-bf0d05dc-0a71-4f3f-8550-cd7fafeaaa6c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.234302 Aug 04 02:26:46.152212 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 461/935] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:45 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:47.171520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:47.172137 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:47.178962 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:47.179450 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:47.180379 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:47.180864 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:47.310349 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:47.318575 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-af876fc9-2caf-43cf-9468-544b1866db73 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.150880 Aug 04 02:26:47.319158 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 475/936] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:47 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:48.340028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:48.340640 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:48.348132 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:48.348573 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:48.349363 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:48.349801 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:48.476979 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:48.485060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-21958a1f-ba1a-4b71-a968-f6b3286f094f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.149584 Aug 04 02:26:48.485846 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 462/937] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:48 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:49.505334 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:49.505939 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:49.512345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:49.512833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:49.513606 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:49.514045 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:49.642139 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:49.650315 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b7af213b-edea-4a2f-af4a-f63590636a3c tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.148761 Aug 04 02:26:49.650884 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 476/938] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:49 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:50.550963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-0b77c160-aea6-4587-b2da-f63cf7c29bc3 req-33358275-18c6-487f-83ba-d98e4e5a0649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4043cf-ce9f-4a41-bd25-194e27776986", "name": "network-vif-plugged", "status": "completed", "tag": "324a1895-e679-4f2c-89b8-1cdd563d2bea"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:50.562086 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0b77c160-aea6-4587-b2da-f63cf7c29bc3 req-33358275-18c6-487f-83ba-d98e4e5a0649 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:50.562876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-0b77c160-aea6-4587-b2da-f63cf7c29bc3 req-33358275-18c6-487f-83ba-d98e4e5a0649 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:50.574641 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-0b77c160-aea6-4587-b2da-f63cf7c29bc3 req-33358275-18c6-487f-83ba-d98e4e5a0649 service nova] Creating event network-vif-plugged:324a1895-e679-4f2c-89b8-1cdd563d2bea for instance bc4043cf-ce9f-4a41-bd25-194e27776986 on hv-cinder-74014 Aug 04 02:26:50.580373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-0b77c160-aea6-4587-b2da-f63cf7c29bc3 req-33358275-18c6-487f-83ba-d98e4e5a0649 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Aug 04 02:26:50.581131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 463/939] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:50.670563 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:50.671219 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:50.678812 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:50.679271 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:50.680058 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:50.680498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:50.869345 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:50.877470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b30d5765-8620-4fee-b7d8-8fdb495d3384 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1319 microversion: 2.1 time: 0.210386 Aug 04 02:26:50.878042 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 477/940] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:50 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:51.898341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:51.899047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:51.905699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:51.906270 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:51.906920 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:51.907354 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:52.043692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:26:52.051065 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1eb7adc1-dcaf-4fec-b73d-bcf0a0b00a76 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1507 microversion: 2.1 time: 0.156915 Aug 04 02:26:52.051628 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 464/941] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:26:51 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:26:52.072070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df034eed-4d8f-4fbb-8696-284dc306f806", "device": "/dev/sdb"}} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:52.074670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:52.081886 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:52.082340 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:52.083127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:52.083567 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:52.370470 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-0a05a162-45fc-4fb9-a808-491fd14117b0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "POST /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302441 Aug 04 02:26:52.371167 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 478/942] 10.222.0.45 () {60 vars in 1323 bytes} [Thu Aug 4 02:26:52 2022] POST /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:52.608497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1807805979"}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:52.609061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:52.611714 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:52.617351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:52.617804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:52.618572 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:52.619038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:52.748595 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.network.security_group_api [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Removing security group 88174330-137d-45cf-91a0-6fbf482d4048 from port 92139371-2e53-454b-9e82-e159aac502fd Aug 04 02:26:53.058941 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-353d0939-6d42-47c6-8ab2-9f4cc681c324 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action" status: 202 len: 0 microversion: 2.1 time: 0.454281 Aug 04 02:26:53.060175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 465/943] 10.222.0.45 () {60 vars in 1278 bytes} [Thu Aug 4 02:26:52 2022] POST /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:26:53.066712 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:53.067841 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=6 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:53.073204 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-8ed40e81-583f-4cba-a91f-2408a0633956 req-b3680602-ba59-4b0c-b9be-92f42d9a6bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:53.084742 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-8ed40e81-583f-4cba-a91f-2408a0633956 req-b3680602-ba59-4b0c-b9be-92f42d9a6bd5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:53.085120 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-8ed40e81-583f-4cba-a91f-2408a0633956 req-b3680602-ba59-4b0c-b9be-92f42d9a6bd5 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:53.097443 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-8ed40e81-583f-4cba-a91f-2408a0633956 req-b3680602-ba59-4b0c-b9be-92f42d9a6bd5 service nova] Creating event network-changed:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:26:53.102670 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-8ed40e81-583f-4cba-a91f-2408a0633956 req-b3680602-ba59-4b0c-b9be-92f42d9a6bd5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036641 Aug 04 02:26:53.103503 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 479/944] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:54.275610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:54.276341 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:54.279419 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-4697184d-b8c9-405d-beef-2e3a75930177 req-ecc64097-221e-43b4-9ab4-71bb0cbc521f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:26:54.283739 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:54.285556 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:54.286546 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:54.287151 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:54.290520 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-4697184d-b8c9-405d-beef-2e3a75930177 req-ecc64097-221e-43b4-9ab4-71bb0cbc521f service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:54.291075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-4697184d-b8c9-405d-beef-2e3a75930177 req-ecc64097-221e-43b4-9ab4-71bb0cbc521f service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:54.303000 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-4697184d-b8c9-405d-beef-2e3a75930177 req-ecc64097-221e-43b4-9ab4-71bb0cbc521f service nova] Creating event network-changed:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:26:54.308394 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-4697184d-b8c9-405d-beef-2e3a75930177 req-ecc64097-221e-43b4-9ab4-71bb0cbc521f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033001 Aug 04 02:26:54.309431 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 480/945] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:54.539280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lazy-loading 'services' on Instance uuid 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:26:54.636349 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-56246fed-78e5-4bd6-9b9e-6a6128d7482c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments/1d814c28-1d56-4c5a-bb93-a48070d23c05" status: 202 len: 0 microversion: 2.1 time: 0.365464 Aug 04 02:26:54.637167 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 466/946] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:26:54 2022] DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments/1d814c28-1d56-4c5a-bb93-a48070d23c05 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:26:54.650762 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:54.653857 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:54.662162 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:54.662933 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:54.663964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:54.664823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:54.704998 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-37b6abdc-ae25-4c74-bc09-35517342abdf tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062665 Aug 04 02:26:54.706088 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 481/947] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:54 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:55.719252 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:55.722265 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:55.728531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:55.729014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:55.729779 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:55.730220 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:55.766896 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-d5e7bb07-2b1c-49a2-b044-3fb5d6c604f7 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052222 Aug 04 02:26:55.767894 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 467/948] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:55 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:56.779176 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:56.781326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:56.788310 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:56.788826 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:56.789603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:56.790041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:56.820282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-feea4bda-0bc8-4614-ba2c-1a7436dc4763 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 04 02:26:56.820875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 482/949] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:56 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:57.833500 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:57.835728 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:57.842248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:57.842705 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:57.843474 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:57.844169 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:57.872207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b89d5ea3-2d36-4fd7-8294-eb6eb886e9c4 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Aug 04 02:26:57.872809 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 468/950] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:57 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:58.886018 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:58.888537 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:58.897358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:58.898039 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:58.898971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:58.900132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:58.932519 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f4c1ff83-a0c5-4a1f-a1b4-ba6bf9ad10c8 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Aug 04 02:26:58.933234 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 483/951] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:58 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:26:59.945183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:26:59.947257 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:26:59.949641 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=31 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:59.955604 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:59.956047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:59.956832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:26:59.957281 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:26:59.986071 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c9f6aecc-d42d-46a2-a0f1-ca2387634148 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Aug 04 02:26:59.986615 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 469/952] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:26:59 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:00.863491 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:00.864066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:00.866481 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:00.871860 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:00.872311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:00.873113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:00.873553 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:00.879209 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:00.902687 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:27:00.979610 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5ba7ce48-e265-415a-9cf7-e8ce489daef5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 204 len: 0 microversion: 2.1 time: 0.119478 Aug 04 02:27:00.980200 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 484/953] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:27:00 2022] DELETE /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:27:00.988909 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:00.989526 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:00.996113 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:00.996568 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:00.997390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:00.997832 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:00.998768 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:01.001544 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:01.007621 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:01.008077 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:01.008917 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:01.009355 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:01.040020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4ff9145e-d43e-4681-988b-ecdec702d54c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 04 02:27:01.040840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 485/954] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:27:00 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:01.136566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:01.144064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-85d65420-1acd-47eb-a92c-76f04a9d89c0 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1577 microversion: 2.1 time: 0.159343 Aug 04 02:27:01.144649 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 470/955] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:00 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:02.053348 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:02.055475 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:02.062025 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:02.062480 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:02.063259 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:02.064391 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:02.098548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2453761d-e50a-4738-ab51-a940da655825 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049030 Aug 04 02:27:02.099253 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 486/956] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:27:02 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:02.164833 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:02.165458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:02.172675 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:02.173312 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:02.174006 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:02.174447 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:02.305326 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:02.312748 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-70ef5567-889e-4588-ada6-8c5d601a42a2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1577 microversion: 2.1 time: 0.151926 Aug 04 02:27:02.313324 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 471/957] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:02 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:03.111315 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:03.113666 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:03.120787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.121246 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.122068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.122499 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.152760 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-b9a53b5e-c540-41bc-9271-8c1846c42deb tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045895 Aug 04 02:27:03.153330 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 487/958] 10.222.0.45 () {58 vars in 1302 bytes} [Thu Aug 4 02:27:03 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 02:27:03.164266 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:03.164863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:03.171479 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.171924 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.172742 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.173800 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.252602 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] HTTP exception thrown: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 is not attached to volume 1d814c28-1d56-4c5a-bb93-a48070d23c05 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Request method failure captured: Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments/1d814c28-1d56-4c5a-bb93-a48070d23c05 HTTP/1.1 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y3Ja5eNxHTlGUI9Mv16YzM-r6jY1KC5eTwTHTwpIQaZEbiVubDNmI03SabyqrFo-R5nqfF7OgTBN7luNahHWH0Gf56eie9pLn5DPZLWZqjqUMCO_3zIzkrf4eyueItxB8-2cjOWfYGWcV43cAjA5uSnKKRmFneDcRKikEuSabUty5U Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 06f7c91a924c447fbca1b6a784d7b167 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:27:03.255340 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 06f7c91a924c447fbca1b6a784d7b167 Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-TestMinimumBasicScenario-2056220368-project Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: fb3a977fea2c499eb915bc059ab01a79 Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-TestMinimumBasicScenario-2056220368-project Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:27:03.256914 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 is not attached to volume 1d814c28-1d56-4c5a-bb93-a48070d23c05 Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'server_id': '5e6d7561-c7b2-4903-b4cd-1e1910e10dd7', 'id': '1d814c28-1d56-4c5a-bb93-a48070d23c05'} Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1d814c28-1d56-4c5a-bb93-a48070d23c05. Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:27:03.261183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 is not attached to volume 1d814c28-1d56-4c5a-bb93-a48070d23c05 Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 is not attached to volume 1d814c28-1d56-4c5a-bb93-a48070d23c05 Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:03.262744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Returning 404 to user: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 is not attached to volume 1d814c28-1d56-4c5a-bb93-a48070d23c05 {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:27:03.263988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-abb64ed5-9c92-449d-831e-494e38876984 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments/1d814c28-1d56-4c5a-bb93-a48070d23c05" status: 404 len: 154 microversion: 2.1 time: 0.096562 Aug 04 02:27:03.263988 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 472/959] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:27:03 2022] DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7/os-volume_attachments/1d814c28-1d56-4c5a-bb93-a48070d23c05 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:27:03.334993 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:03.335882 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:03.342113 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.342570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.343421 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:03.344293 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:03.805365 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:03.812921 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a7db734c-57dd-44d9-bd40-32adac7522a7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1577 microversion: 2.1 time: 0.482170 Aug 04 02:27:03.813990 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 488/960] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:03 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1577 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:04.834892 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:04.835466 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:04.844408 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:04.845518 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:04.846332 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:04.846776 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:05.059014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:05.066907 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1e570980-475a-42c7-b0c7-52b54b75af86 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1577 microversion: 2.1 time: 0.235848 Aug 04 02:27:05.067666 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 473/961] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:04 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:05.373289 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-45e3349e-b81d-4871-946d-f487f22291d1 req-fc56fc33-0fe3-4f9b-a1cd-28f96e917274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3332bb9-b241-4099-9834-2c22f1241a44", "name": "network-vif-deleted", "tag": "11df299a-5e37-4167-9de3-78f09f622f02"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:05.385632 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-45e3349e-b81d-4871-946d-f487f22291d1 req-fc56fc33-0fe3-4f9b-a1cd-28f96e917274 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:05.386075 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-45e3349e-b81d-4871-946d-f487f22291d1 req-fc56fc33-0fe3-4f9b-a1cd-28f96e917274 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:05.398280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-45e3349e-b81d-4871-946d-f487f22291d1 req-fc56fc33-0fe3-4f9b-a1cd-28f96e917274 service nova] Creating event network-vif-deleted:11df299a-5e37-4167-9de3-78f09f622f02 for instance b3332bb9-b241-4099-9834-2c22f1241a44 on hv-cinder-74014 Aug 04 02:27:05.403333 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-45e3349e-b81d-4871-946d-f487f22291d1 req-fc56fc33-0fe3-4f9b-a1cd-28f96e917274 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033699 Aug 04 02:27:05.404143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 489/962] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:06.093387 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:06.094312 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:06.101750 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:06.102210 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:06.102997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:06.103438 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:06.168517 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:06.177030 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-47175f45-74c6-46c9-809f-0e973a133762 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 200 len: 1510 microversion: 2.1 time: 0.087451 Aug 04 02:27:06.177630 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 474/963] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:06 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:07.199142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:07.199756 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:07.206521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.206974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.207754 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.208199 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.221490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] HTTP exception thrown: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Request method failure captured: Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 HTTP/1.1 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y22raoOdXZU56m4OyWKNpa1ZcFPWPIntn2a9iQ5Ojtl2oYsQJAmly6RJOVt0tx_1WIq1ZXB5ChK7HbRFUrLee-KyVWOuhL_Q7wTo-fkncltjZCuQEadIdZ8ZbuHCWM8S_OG9XG-fH20YN4FbBYYyl9XgHHjbYOtKyTbvoK8tOSu6jI Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:27:07.223127 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 683f8f120df946f59505455a9ab2dc2a Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:27:07.224802 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'b3332bb9-b241-4099-9834-2c22f1241a44'} Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:27:07.225916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:27:07.227472 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:07.228988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Returning 404 to user: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:27:07.228988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c624881c-50f8-49c7-87be-f861f70b9453 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 404 len: 111 microversion: 2.1 time: 0.029673 Aug 04 02:27:07.228988 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 490/964] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:07 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:27:07.320074 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-255592382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537706057", "security_groups": [{"name": "tempest-secgroup-smoke-689449970"}], "block_device_mapping_v2": [{"uuid": "63ff9f45-d8f1-4ec8-ba7f-36171883e067", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4"}]}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:07.433685 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] validate_networks() for [('c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:27:07.569709 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:07.570205 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:07.576467 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.577037 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.578094 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.578704 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.606869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Going to try to terminate instance {{(pid=118168) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:27:07.691298 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-601e3576-25b4-4688-886e-afa42fe42a51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 204 len: 0 microversion: 2.1 time: 0.124191 Aug 04 02:27:07.692005 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 491/965] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:27:07 2022] DELETE /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 02:27:07.700833 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:07.701465 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:07.708785 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.709249 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.710029 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.710471 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.890955 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:27:07.891401 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:27:07.891866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:27:07.892265 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:27:07.892696 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:27:07.901485 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.901934 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.902724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:07.903153 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:07.908415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:07.916438 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-428c258c-625f-4ddf-8075-99e3c3f5875c tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1555 microversion: 2.1 time: 0.219757 Aug 04 02:27:07.917061 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 492/966] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:07 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:27:07.920406 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:27:07.925186 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for user 683f8f120df946f59505455a9ab2dc2a and project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:27:07.981223 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:27:07.983300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63ff9f45-d8f1-4ec8-ba7f-36171883e067',volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:27:08.112373 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b5d28767-0fba-46e9-be69-dbfca81b2501 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796277 Aug 04 02:27:08.113051 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 475/967] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:27:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:27:08.124517 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a4bf70c7-a0be-4a1a-9958-b7542eaf5390 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:08.125231 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a4bf70c7-a0be-4a1a-9958-b7542eaf5390 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:08.182949 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a4bf70c7-a0be-4a1a-9958-b7542eaf5390 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:08.191270 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a4bf70c7-a0be-4a1a-9958-b7542eaf5390 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1094 microversion: 2.1 time: 0.071362 Aug 04 02:27:08.192401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 493/968] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:08 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:08.938388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:08.939481 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:08.945790 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:08.946244 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:08.947010 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:08.947453 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:09.074048 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:09.082278 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-82249eff-a417-4eef-9704-1db8aed8bbed tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1555 microversion: 2.1 time: 0.148331 Aug 04 02:27:09.082844 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 476/969] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:08 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:09.215905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:09.216765 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:09.225066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:09.225521 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:09.226287 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:09.226718 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:09.290129 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:09.297800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-46340cc8-c25f-4622-b579-778c5ba423f8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1136 microversion: 2.1 time: 0.088927 Aug 04 02:27:09.298408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 494/970] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:09 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1136 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:10.103744 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:10.104346 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:10.111524 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.112131 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.113005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.113458 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.319851 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:10.321408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:10.335995 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.338551 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a977fea2c499eb915bc059ab01a79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f7c91a924c447fbca1b6a784d7b167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:10.339159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.340046 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.340558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.352094 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7ab46cf5-df2e-4efd-9ec1-1544f9cd347e tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 200 len: 1555 microversion: 2.1 time: 0.252759 Aug 04 02:27:10.353693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 477/971] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:10 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:10.403435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-6aa885c7-3110-4b8c-b01e-d0308cbe909a req-4837189f-6b6f-4f16-bb8e-8e17f89c803d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6d7561-c7b2-4903-b4cd-1e1910e10dd7", "name": "network-vif-deleted", "tag": "92139371-2e53-454b-9e82-e159aac502fd"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:10.414191 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-6aa885c7-3110-4b8c-b01e-d0308cbe909a req-4837189f-6b6f-4f16-bb8e-8e17f89c803d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.414930 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-6aa885c7-3110-4b8c-b01e-d0308cbe909a req-4837189f-6b6f-4f16-bb8e-8e17f89c803d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.419080 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:10.429549 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-6aa885c7-3110-4b8c-b01e-d0308cbe909a req-4837189f-6b6f-4f16-bb8e-8e17f89c803d service nova] Creating event network-vif-deleted:92139371-2e53-454b-9e82-e159aac502fd for instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 on hv-cinder-74014 Aug 04 02:27:10.435439 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-6aa885c7-3110-4b8c-b01e-d0308cbe909a req-4837189f-6b6f-4f16-bb8e-8e17f89c803d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035483 Aug 04 02:27:10.436264 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 478/972] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:27:10.461070 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:10.470558 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a368a7bf-2f6f-48fa-8670-2e85f06a85b6 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1200 microversion: 2.1 time: 0.154513 Aug 04 02:27:10.471164 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 495/973] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:10 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1200 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:27:10.791845 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:10.792531 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:10.800237 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.805029 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.806339 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:10.807018 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:10.926733 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lazy-loading 'services' on Instance uuid bc4043cf-ce9f-4a41-bd25-194e27776986 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:27:11.044717 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f1e2fa16-1714-40ac-b252-3cdaa66505a5 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986/os-volume_attachments/df034eed-4d8f-4fbb-8696-284dc306f806" status: 202 len: 0 microversion: 2.1 time: 0.257830 Aug 04 02:27:11.045469 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 479/974] 10.222.0.45 () {58 vars in 1416 bytes} [Thu Aug 4 02:27:10 2022] DELETE /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986/os-volume_attachments/df034eed-4d8f-4fbb-8696-284dc306f806 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:27:11.376403 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:11.377043 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] [instance: 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:11.383979 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:11.384436 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:11.385279 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:11.385705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:11.411084 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] HTTP exception thrown: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Request method failure captured: Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 HTTP/1.1 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y3Ja5eNxHTlGUI9Mv16YzM-r6jY1KC5eTwTHTwpIQaZEbiVubDNmI03SabyqrFo-R5nqfF7OgTBN7luNahHWH0Gf56eie9pLn5DPZLWZqjqUMCO_3zIzkrf4eyueItxB8-2cjOWfYGWcV43cAjA5uSnKKRmFneDcRKikEuSabUty5U Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 06f7c91a924c447fbca1b6a784d7b167 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:27:11.413019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06f7c91a924c447fbca1b6a784d7b167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 06f7c91a924c447fbca1b6a784d7b167 Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2056220368 Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestMinimumBasicScenario-2056220368-project Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: fb3a977fea2c499eb915bc059ab01a79 Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestMinimumBasicScenario-2056220368-project Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. Aug 04 02:27:11.414486 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '5e6d7561-c7b2-4903-b4cd-1e1910e10dd7'} Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:27:11.415282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. Aug 04 02:27:11.416570 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:27:11.417907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Returning 404 to user: Instance 5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:27:11.417907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-f4e27273-704a-41e1-971b-b54965957f51 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7" status: 404 len: 111 microversion: 2.1 time: 0.041856 Aug 04 02:27:11.417907 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 496/975] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:11 2022] GET /compute/v2.1/servers/5e6d7561-c7b2-4903-b4cd-1e1910e10dd7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:27:11.425859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6558c297-429b-4da5-a69f-090c3376b1b6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] Calling method '.version_select at 0x7ff48f5a5ca0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:11.451490 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6558c297-429b-4da5-a69f-090c3376b1b6 tempest-TestMinimumBasicScenario-2056220368 tempest-TestMinimumBasicScenario-2056220368-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-282558098" status: 202 len: 0 microversion: 2.1 time: 0.031595 Aug 04 02:27:11.453769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 480/976] 10.222.0.45 () {58 vars in 1269 bytes} [Thu Aug 4 02:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-282558098 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:27:11.491857 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:11.495912 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:11.503009 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:11.503722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:11.504681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:11.505302 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:11.743124 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:11.753138 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-6e6c1155-cd0a-44c8-9e4c-0c6e7e316d70 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.264388 Aug 04 02:27:11.764894 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 497/977] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:11 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:12.190248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:12.190866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:12.197597 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.198119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.198969 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.199588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.232771 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-92d7a773-7612-4071-96af-dbaac47f5175 req-e8eae0e9-5879-4d6d-a85e-05040f97ea22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b22a41-b90f-4c6f-b5b5-697dde2d49b8", "tag": "464771be-6667-4cc4-9015-5245b584f7ec"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:12.234992 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:27:12.248148 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-92d7a773-7612-4071-96af-dbaac47f5175 req-e8eae0e9-5879-4d6d-a85e-05040f97ea22 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.248844 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-92d7a773-7612-4071-96af-dbaac47f5175 req-e8eae0e9-5879-4d6d-a85e-05040f97ea22 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.272705 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-92d7a773-7612-4071-96af-dbaac47f5175 req-e8eae0e9-5879-4d6d-a85e-05040f97ea22 service nova] Creating event network-changed:464771be-6667-4cc4-9015-5245b584f7ec for instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 on hv-cinder-74014 Aug 04 02:27:12.278272 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-92d7a773-7612-4071-96af-dbaac47f5175 req-e8eae0e9-5879-4d6d-a85e-05040f97ea22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058943 Aug 04 02:27:12.279226 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 498/978] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:27:12.327014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-14fb04b1-be8d-4a8b-8437-bf57beb8ee54 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 204 len: 0 microversion: 2.1 time: 0.140592 Aug 04 02:27:12.328388 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 481/979] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:27:12 2022] DELETE /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:27:12.337478 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:12.338185 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:12.346344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.346800 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.347593 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.348038 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.478873 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:12.486605 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-5c39d8aa-7966-43cd-a2f7-8e35e4d5503b tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1513 microversion: 2.1 time: 0.153314 Aug 04 02:27:12.487288 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 499/980] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:12 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:27:12.777135 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:12.778118 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:12.785402 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.785855 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.786692 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:12.787126 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:12.928036 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:12.935713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-1b262ba9-ffc4-401b-885a-0f12fc3915c8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.163704 Aug 04 02:27:12.936282 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 482/981] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:12 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:13.510197 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:13.511179 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:13.517733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:13.518192 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:13.519040 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:13.519490 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:13.661745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:13.669915 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-09212a01-6205-48c7-a66b-2eaa511fc8f0 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1513 microversion: 2.1 time: 0.165695 Aug 04 02:27:13.670446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 500/982] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:13 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:13.959199 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:13.959746 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:13.966418 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:13.966876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:13.967662 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:13.968103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:14.238927 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:14.247326 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-5f9ce00d-f341-408b-aded-17b44bf26e3f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.292194 Aug 04 02:27:14.248073 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 483/983] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:13 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:14.693267 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:14.694608 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:14.704170 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:14.705573 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:14.708749 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:14.709548 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:14.715208 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:14.836324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc39daa4b074ddeb97755f1b1535f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fd26658f57474aba12bceb6b9c7176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:14.848364 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2f68c9a6-c26b-47c8-a3df-6cba5bdc2de4 tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 200 len: 1471 microversion: 2.1 time: 0.160673 Aug 04 02:27:14.849555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 501/984] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:14 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:14.983264 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-f095e92a-b29b-44e4-a641-3f7eeedfdefa req-ede1fdf9-776c-4bf6-873d-ef4fd40a7af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc4043cf-ce9f-4a41-bd25-194e27776986", "name": "network-vif-deleted", "tag": "324a1895-e679-4f2c-89b8-1cdd563d2bea"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:14.994628 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f095e92a-b29b-44e4-a641-3f7eeedfdefa req-ede1fdf9-776c-4bf6-873d-ef4fd40a7af0 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:14.995351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-f095e92a-b29b-44e4-a641-3f7eeedfdefa req-ede1fdf9-776c-4bf6-873d-ef4fd40a7af0 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:15.008451 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-f095e92a-b29b-44e4-a641-3f7eeedfdefa req-ede1fdf9-776c-4bf6-873d-ef4fd40a7af0 service nova] Creating event network-vif-deleted:324a1895-e679-4f2c-89b8-1cdd563d2bea for instance bc4043cf-ce9f-4a41-bd25-194e27776986 on hv-cinder-74014 Aug 04 02:27:15.013636 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-f095e92a-b29b-44e4-a641-3f7eeedfdefa req-ede1fdf9-776c-4bf6-873d-ef4fd40a7af0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Aug 04 02:27:15.014322 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 484/985] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:15.027775 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:27:15.027977 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:27:15.268722 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:15.269336 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:15.282816 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:15.283181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:15.283954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:15.284390 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:15.536877 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:15.547667 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-1e81b324-4206-41da-983d-65a937b7d35a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.282754 Aug 04 02:27:15.548252 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 502/986] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:15 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:15.870475 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:15.871177 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] [instance: bc4043cf-ce9f-4a41-bd25-194e27776986] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:15.878440 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:15.878888 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:15.879683 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:15.880108 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:15.895229 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] HTTP exception thrown: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Request method failure captured: Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 HTTP/1.1 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y4jk53kxVKvoVvF6X-0EuiXF3LMMLgZsfv30LNiezCaT34Kz9PfUM0DLoFHFrgfZ8faQx5IG20-jKSoHvnJU9A-muWZjzCMu3-oZ_KSJ0lfZsmV6YP0Tn3oC4nH9v6qZne0C1m-cGJ5CzBl4tbNkqL_r_BqI5wrfyoEOfzki7yZCic Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: b8fd26658f57474aba12bceb6b9c7176 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:27:15.897106 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b8fd26658f57474aba12bceb6b9c7176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: b8fd26658f57474aba12bceb6b9c7176 Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1790777867 Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-VolumesSnapshotTestJSON-1790777867-project Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: ccc39daa4b074ddeb97755f1b1535f50 Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-VolumesSnapshotTestJSON-1790777867-project Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. Aug 04 02:27:15.898605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'bc4043cf-ce9f-4a41-bd25-194e27776986'} Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:27:15.899442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. Aug 04 02:27:15.901456 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:27:15.903431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] Returning 404 to user: Instance bc4043cf-ce9f-4a41-bd25-194e27776986 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:27:15.903431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-396aedf7-f8ac-48c1-b4db-15ef671aab8f tempest-VolumesSnapshotTestJSON-1790777867 tempest-VolumesSnapshotTestJSON-1790777867-project] 10.222.0.45 "GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986" status: 404 len: 111 microversion: 2.1 time: 0.032386 Aug 04 02:27:15.903431 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 485/987] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:15 2022] GET /compute/v2.1/servers/bc4043cf-ce9f-4a41-bd25-194e27776986 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:27:16.569245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:16.569777 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:16.576388 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:16.576875 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:16.577686 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:16.578131 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:16.791922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:16.800678 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc9789b3-541a-4465-a352-1bd193bb5a08 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.235381 Aug 04 02:27:16.801245 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 503/988] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:16 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:17.821437 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:17.821993 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:17.828250 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:17.828724 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:17.829504 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:17.829943 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:17.911700 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:17.931390 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:17.987452 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:17.995530 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-7a4e2252-db02-457c-9ac8-01db99d15f9c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.177960 Aug 04 02:27:17.996704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 486/989] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:17 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:19.020014 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:19.020930 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:19.024401 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:19.029143 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:19.029609 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:19.030415 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:19.030991 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:19.182662 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:19.193301 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4000a37e-79f9-4694-bbea-27bbca1fdbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.179439 Aug 04 02:27:19.195020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 504/990] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:19 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:20.214060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:20.214765 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:20.221693 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:20.222142 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:20.222905 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:20.223334 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:20.357910 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:20.365587 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f266b558-997b-4ef2-bc9a-8f69689b39ca tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.155352 Aug 04 02:27:20.366451 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 487/991] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:20 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:21.388117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:21.388748 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:21.396068 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:21.396515 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:21.397381 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:21.397729 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:21.529325 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:21.537532 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c4da25b3-0749-494f-b5b5-85d02b0caa82 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.153256 Aug 04 02:27:21.538107 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 505/992] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:21 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:22.558176 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:22.558796 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:22.565588 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:22.566045 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:22.566892 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:22.567337 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:22.721179 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:22.728866 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-3e7aba29-eac6-4278-9ce4-365d55385600 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.174548 Aug 04 02:27:22.729442 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 488/993] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:22 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:23.750733 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:23.751867 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:23.759020 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:23.759483 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:23.760264 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:23.760738 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:23.893248 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:23.900698 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3762d4fe-73f1-4499-ae0a-e916f04fe638 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.153905 Aug 04 02:27:23.901268 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 506/994] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:23 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:24.739647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-1ea56f2d-4c3b-41ca-bc67-64dbb5bfdf50 req-b8e0e9de-de35-49bd-9e16-7e59605f9fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b22a41-b90f-4c6f-b5b5-697dde2d49b8", "name": "network-vif-plugged", "status": "completed", "tag": "464771be-6667-4cc4-9015-5245b584f7ec"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:24.751769 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-1ea56f2d-4c3b-41ca-bc67-64dbb5bfdf50 req-b8e0e9de-de35-49bd-9e16-7e59605f9fdf service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:24.752213 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-1ea56f2d-4c3b-41ca-bc67-64dbb5bfdf50 req-b8e0e9de-de35-49bd-9e16-7e59605f9fdf service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:24.764658 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-1ea56f2d-4c3b-41ca-bc67-64dbb5bfdf50 req-b8e0e9de-de35-49bd-9e16-7e59605f9fdf service nova] Creating event network-vif-plugged:464771be-6667-4cc4-9015-5245b584f7ec for instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 on hv-cinder-74014 Aug 04 02:27:24.770577 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-1ea56f2d-4c3b-41ca-bc67-64dbb5bfdf50 req-b8e0e9de-de35-49bd-9e16-7e59605f9fdf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034754 Aug 04 02:27:24.771436 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 489/995] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:27:24.921855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:24.922681 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:24.928854 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:24.929360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:24.930311 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:24.930701 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:25.071356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:25.079078 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-95837cad-edda-474e-a2ae-ebc43a8e9d0f tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.161706 Aug 04 02:27:25.079646 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 507/996] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:24 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:26.102012 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:26.102934 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:26.109973 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:26.110474 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:26.111416 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:26.112068 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:26.241789 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:26.249371 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a18ea2aa-c915-440a-a53a-0fd02008f6b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.152542 Aug 04 02:27:26.249933 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 490/997] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:26 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:27.271217 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:27.271844 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:27.277968 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:27.278424 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:27.279196 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:27.279637 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:27.416547 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:27.424061 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-39627820-13cf-4f09-b7ca-86eb4341b4f1 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.156879 Aug 04 02:27:27.424628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 508/998] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:27 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:27:28.445419 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:28.445968 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:28.452545 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:28.453061 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:28.453794 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:28.454224 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:28.588313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:28.596994 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-4dc37949-db78-46a8-b29b-47671a472e18 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1265 microversion: 2.1 time: 0.155754 Aug 04 02:27:28.597621 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 491/999] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:28 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:29.618416 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:29.619030 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:29.625691 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:29.626695 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:29.627471 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:29.627914 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:29.770344 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:29.777945 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-3c78d99c-5afd-4b48-a165-5d4211fd543c tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1452 microversion: 2.1 time: 0.164236 Aug 04 02:27:29.778512 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 509/1000] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:29 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:29.805764 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:27:29.806376 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:27:29.812893 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:29.813932 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:29.814719 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:29.815151 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:29.945610 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:27:29.953239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-16f34575-fb4b-4859-831d-af221c04f81b tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1452 microversion: 2.1 time: 0.152486 Aug 04 02:27:29.953807 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 492/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:27:29 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:27:31.555575 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-15bcc458-e131-4ba3-881f-a6c7c0041972 req-f49e4b44-fbf5-4414-a190-655ac4e35697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b22a41-b90f-4c6f-b5b5-697dde2d49b8", "tag": "464771be-6667-4cc4-9015-5245b584f7ec"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:27:31.563404 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:31.567766 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-15bcc458-e131-4ba3-881f-a6c7c0041972 req-f49e4b44-fbf5-4414-a190-655ac4e35697 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:27:31.568393 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-15bcc458-e131-4ba3-881f-a6c7c0041972 req-f49e4b44-fbf5-4414-a190-655ac4e35697 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:27:31.582840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-15bcc458-e131-4ba3-881f-a6c7c0041972 req-f49e4b44-fbf5-4414-a190-655ac4e35697 service nova] Creating event network-changed:464771be-6667-4cc4-9015-5245b584f7ec for instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 on hv-cinder-74014 Aug 04 02:27:31.588905 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-15bcc458-e131-4ba3-881f-a6c7c0041972 req-f49e4b44-fbf5-4414-a190-655ac4e35697 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036480 Aug 04 02:27:31.592842 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 510/1002] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:18.366870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e3f25f1-cb44-4f46-b37e-f7e92a0a3c24] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 02:29:18.368294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:18.369047 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:18.373104 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-378996229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537706057", "security_groups": [{"name": "tempest-secgroup-smoke-689449970"}], "block_device_mapping_v2": [{"uuid": "9d5bba06-ebea-461d-bed0-12708c21926f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4"}]}} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:18.489427 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.network.neutron [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] validate_networks() for [('c16c7bd4-f700-4c70-8efd-ac9ecb8b1aa4', None, None, None, None, None)] {{(pid=118167) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 02:29:18.864087 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 02:29:18.864535 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image limits 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 02:29:18.864995 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Flavor pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 02:29:18.865410 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Image pref 0:0:0 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 02:29:18.865824 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.virt.hardware [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 02:29:18.874641 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:18.875089 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:18.875885 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:18.876321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:18.893052 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 02:29:18.897248 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.quota [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Getting quotas for user 683f8f120df946f59505455a9ab2dc2a and project 5f4683550a9d40d1ab0439d002d73749. Resources: {'instances', 'ram', 'cores'} {{(pid=118167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 02:29:18.953424 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Going to run 1 instances... {{(pid=118167) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 02:29:18.955559 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d5bba06-ebea-461d-bed0-12708c21926f',volume_size=None,volume_type=None)] {{(pid=118167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 02:29:19.082804 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-b3264494-31dc-4bbb-a2a9-ca462b98f8ae tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.717706 Aug 04 02:29:19.083432 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 493/1003] 10.222.0.45 () {60 vars in 1147 bytes} [Thu Aug 4 02:29:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 02:29:19.093488 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2184059-d97f-459c-ad0d-cfdc15663291] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 02:29:19.094142 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=55 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:19.094861 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=1 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:19.099494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-acae880b-4d27-412c-9766-32df30f3b6e2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:19.100194 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-acae880b-4d27-412c-9766-32df30f3b6e2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:19.154787 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-acae880b-4d27-412c-9766-32df30f3b6e2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:19.161559 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-acae880b-4d27-412c-9766-32df30f3b6e2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1094 microversion: 2.1 time: 0.070400 Aug 04 02:29:19.162156 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 511/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:19 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:20.187876 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e3f25f1-cb44-4f46-b37e-f7e92a0a3c24] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48446. Aug 04 02:29:20.192543 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:20.193089 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:20.199314 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:20.199793 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:20.200558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:20.201034 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:20.585183 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:20.595014 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-217404c1-5f59-41ad-9108-4bba6305a86a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1210 microversion: 2.1 time: 0.416557 Aug 04 02:29:20.596020 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 494/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:20 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1210 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:21.615324 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:21.616031 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:21.627437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2184059-d97f-459c-ad0d-cfdc15663291] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48450. Aug 04 02:29:21.631941 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:21.632394 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:21.633213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:21.633653 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:21.867522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:21.876024 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-2e694fe2-35c5-44f4-992f-4c8c833b5810 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.264521 Aug 04 02:29:21.884756 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 512/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:21 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:21.888060 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-2a660bac-9a4f-4749-8376-24cb061d4d5c req-400eb80a-ea7d-470d-9ba3-e4f624d2a9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd5241-bfc3-4826-b22d-8b5806f257c3", "tag": "cec92996-e650-4cdb-819d-b77297a9d55d"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:21.903133 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-2a660bac-9a4f-4749-8376-24cb061d4d5c req-400eb80a-ea7d-470d-9ba3-e4f624d2a9dd service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:21.903820 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-2a660bac-9a4f-4749-8376-24cb061d4d5c req-400eb80a-ea7d-470d-9ba3-e4f624d2a9dd service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:21.918928 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-2a660bac-9a4f-4749-8376-24cb061d4d5c req-400eb80a-ea7d-470d-9ba3-e4f624d2a9dd service nova] Creating event network-changed:cec92996-e650-4cdb-819d-b77297a9d55d for instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 on hv-cinder-74014 Aug 04 02:29:21.925751 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-2a660bac-9a4f-4749-8376-24cb061d4d5c req-400eb80a-ea7d-470d-9ba3-e4f624d2a9dd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185025 Aug 04 02:29:21.926365 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 495/1007] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:29:22.896728 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:22.897342 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:22.904426 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:22.904902 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:22.905663 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:22.906098 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:23.053408 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:23.061283 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-52159468-856e-4896-a7fb-473057b3e28a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.168414 Aug 04 02:29:23.061840 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 513/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:22 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:24.084141 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:24.084869 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:24.091743 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:24.092198 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:24.093247 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:24.093699 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:24.225443 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:24.232935 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-572f3fc4-693b-4374-94fc-f68921181f91 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.153882 Aug 04 02:29:24.233501 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 496/1009] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:24 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:25.254175 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:25.254843 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:25.261417 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:25.261869 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:25.262647 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:25.263087 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:25.397482 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:25.405848 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-a8c13144-5c79-4159-aa73-0732accdc948 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.155766 Aug 04 02:29:25.406424 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 514/1010] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:25 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:26.427425 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:26.428044 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:26.434880 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:26.435338 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:26.436114 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:26.436558 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:26.567674 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:26.575713 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-26058956-4dc4-454f-8b26-a5c32f27ef50 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.152196 Aug 04 02:29:26.576276 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 497/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:26 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:27.596981 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:27.597593 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:27.604881 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:27.605331 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:27.606110 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:27.606550 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:27.742819 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:27.750236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c8d6403b-0c78-469c-ac26-5a8a55643746 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.157433 Aug 04 02:29:27.750832 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 515/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:27 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:28.770520 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:28.771119 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:28.777605 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:28.778064 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:28.778839 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:28.779285 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:28.884294 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=2 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:28.904057 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell0:SELECT=6 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:28.915460 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:28.923435 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-dba7f358-94a6-4a73-bed8-ccbd12d3f558 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.156633 Aug 04 02:29:28.923887 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 498/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:28 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:29.946169 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:29.946799 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:29.949590 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell0:SELECT=2 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:29.955501 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:29.955954 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:29.956763 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:29.957210 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:30.090326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:30.098108 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-dc8fd05a-dc79-4e7c-b17f-c39887378b96 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.156703 Aug 04 02:29:30.098675 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 516/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:29 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:31.119383 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:31.120000 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:31.126838 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:31.127315 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:31.128082 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:31.128512 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:31.263377 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:31.271274 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-6c39b675-90fc-4e36-bf5a-f56e9bf3c958 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.156029 Aug 04 02:29:31.271847 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 499/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:31 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:32.292761 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:32.293380 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:32.300160 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:32.300630 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:32.301429 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:32.301868 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:32.433149 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:32.440752 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-43095f26-fd08-4c75-b4bf-f5783cfee784 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.152445 Aug 04 02:29:32.441329 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 517/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:32 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:33.433975 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [req-9526d722-227d-405d-a136-4246ed83641e req-6c07b36c-0559-4dc6-a8a4-ec42d3069e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd5241-bfc3-4826-b22d-8b5806f257c3", "name": "network-vif-plugged", "status": "completed", "tag": "cec92996-e650-4cdb-819d-b77297a9d55d"}]} {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:33.445280 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9526d722-227d-405d-a136-4246ed83641e req-6c07b36c-0559-4dc6-a8a4-ec42d3069e2b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:33.445652 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [req-9526d722-227d-405d-a136-4246ed83641e req-6c07b36c-0559-4dc6-a8a4-ec42d3069e2b service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:33.456925 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.compute.server_external_events [req-9526d722-227d-405d-a136-4246ed83641e req-6c07b36c-0559-4dc6-a8a4-ec42d3069e2b service nova] Creating event network-vif-plugged:cec92996-e650-4cdb-819d-b77297a9d55d for instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 on hv-cinder-74014 Aug 04 02:29:33.462446 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [req-9526d722-227d-405d-a136-4246ed83641e req-6c07b36c-0559-4dc6-a8a4-ec42d3069e2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092652 Aug 04 02:29:33.462555 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:33.463001 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:33.465967 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 500/1017] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:29:33.470406 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:33.470855 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:33.471970 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:33.472407 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:33.605935 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:33.613794 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-09688fb6-1b5d-45fe-82c0-1d391666d4bd tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.155888 Aug 04 02:29:33.614358 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 518/1018] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:33 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 02:29:34.635997 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:34.636891 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:34.643243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:34.643704 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:34.644482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:34.644960 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:34.778028 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:34.785445 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-73404b62-0267-47eb-99ac-df2b21acdd65 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1265 microversion: 2.1 time: 0.154737 Aug 04 02:29:34.786045 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 501/1019] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:34 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:35.805986 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:35.806524 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:35.813599 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:35.814054 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:35.814827 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:35.815269 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:35.949964 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:35.957523 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-9d275e4f-7239-42b2-8eea-f2897b747b55 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1451 microversion: 2.1 time: 0.155573 Aug 04 02:29:35.958084 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 519/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:35 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:35.980175 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:29:35.981323 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:29:35.991284 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:35.992981 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:35.992981 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:35.993222 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:36.124152 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:29:36.131580 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-446becc6-fdb8-4b16-add2-0d13d0d564b2 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1451 microversion: 2.1 time: 0.156815 Aug 04 02:29:36.132137 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 502/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:29:35 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:29:37.969071 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-177cc148-c29b-464d-bcce-7f527a21859a req-5819eff0-61e0-41fb-bc87-022240995de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd5241-bfc3-4826-b22d-8b5806f257c3", "tag": "cec92996-e650-4cdb-819d-b77297a9d55d"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:29:37.979249 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-177cc148-c29b-464d-bcce-7f527a21859a req-5819eff0-61e0-41fb-bc87-022240995de8 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:29:37.979778 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-177cc148-c29b-464d-bcce-7f527a21859a req-5819eff0-61e0-41fb-bc87-022240995de8 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:29:37.991462 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-177cc148-c29b-464d-bcce-7f527a21859a req-5819eff0-61e0-41fb-bc87-022240995de8 service nova] Creating event network-changed:cec92996-e650-4cdb-819d-b77297a9d55d for instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 on hv-cinder-74014 Aug 04 02:29:37.997314 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-177cc148-c29b-464d-bcce-7f527a21859a req-5819eff0-61e0-41fb-bc87-022240995de8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032142 Aug 04 02:29:37.997920 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 520/1022] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:30:35.040446 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:30:35.041212 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:31:17.389455 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:17.390378 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG dbcounter [-] [118167] Writing DB stats nova_cell1:SELECT=48 {{(pid=118167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:17.394262 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_api:SELECT=22 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:17.395023 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG dbcounter [-] [118168] Writing DB stats nova_cell1:SELECT=50 {{(pid=118168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:17.404413 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:17.404958 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:17.413612 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:17.414697 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:17.415464 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:17.415908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:17.447730 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:31:17.466165 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-8d5cfcb7-041a-428d-a2d7-41cf7762f719 req-23e08eba-8b49-4873-8e52-7ed63ecbc4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd5241-bfc3-4826-b22d-8b5806f257c3", "tag": "cec92996-e650-4cdb-819d-b77297a9d55d"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:31:17.478019 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-8d5cfcb7-041a-428d-a2d7-41cf7762f719 req-23e08eba-8b49-4873-8e52-7ed63ecbc4b6 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:17.478974 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-8d5cfcb7-041a-428d-a2d7-41cf7762f719 req-23e08eba-8b49-4873-8e52-7ed63ecbc4b6 service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:17.491494 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-8d5cfcb7-041a-428d-a2d7-41cf7762f719 req-23e08eba-8b49-4873-8e52-7ed63ecbc4b6 service nova] Creating event network-changed:cec92996-e650-4cdb-819d-b77297a9d55d for instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 on hv-cinder-74014 Aug 04 02:31:17.498163 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-8d5cfcb7-041a-428d-a2d7-41cf7762f719 req-23e08eba-8b49-4873-8e52-7ed63ecbc4b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105853 Aug 04 02:31:17.499031 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 521/1023] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:31:17.574168 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-ecdc54c5-eeb8-4cf8-9c82-0cd4069a8e15 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 204 len: 0 microversion: 2.1 time: 0.186378 Aug 04 02:31:17.574753 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 503/1024] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:31:17 2022] DELETE /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:31:17.583369 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:17.584061 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:17.591035 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:17.591745 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:17.592522 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:17.592999 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:17.738080 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:17.745888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-87f6bc3c-598e-4aaa-a371-4ea5f7defc4d tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1576 microversion: 2.1 time: 0.166641 Aug 04 02:31:17.746468 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 522/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:17 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:18.767647 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:18.768477 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:18.775515 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:18.775963 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:18.776768 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:18.777239 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:18.933098 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:18.940737 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-07763f4e-0df1-4a4b-9ff6-6b853a29cbb5 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1576 microversion: 2.1 time: 0.177276 Aug 04 02:31:18.941298 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 504/1026] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:18 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:19.541396 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-30bb27fe-7549-458d-a7f1-ec17fe0299fb req-7f1f1ebf-57ba-46cc-98e5-6916c95e70ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd5241-bfc3-4826-b22d-8b5806f257c3", "name": "network-vif-deleted", "tag": "cec92996-e650-4cdb-819d-b77297a9d55d"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:31:19.551607 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-30bb27fe-7549-458d-a7f1-ec17fe0299fb req-7f1f1ebf-57ba-46cc-98e5-6916c95e70ab service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:19.552050 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-30bb27fe-7549-458d-a7f1-ec17fe0299fb req-7f1f1ebf-57ba-46cc-98e5-6916c95e70ab service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:19.563360 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-30bb27fe-7549-458d-a7f1-ec17fe0299fb req-7f1f1ebf-57ba-46cc-98e5-6916c95e70ab service nova] Creating event network-vif-deleted:cec92996-e650-4cdb-819d-b77297a9d55d for instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 on hv-cinder-74014 Aug 04 02:31:19.568132 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-30bb27fe-7549-458d-a7f1-ec17fe0299fb req-7f1f1ebf-57ba-46cc-98e5-6916c95e70ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Aug 04 02:31:19.568747 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 523/1027] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 02:31:19.961812 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:19.962544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:19.969279 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:19.969722 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:19.970482 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:19.970916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:20.001321 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:20.001763 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:20.002200 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lazy-loading 'fault' on Instance uuid d3fd5241-bfc3-4826-b22d-8b5806f257c3 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:31:20.042544 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:20.050076 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-c8d1f332-71f2-483a-8dbf-fbfa1f636306 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 200 len: 1230 microversion: 2.1 time: 0.092061 Aug 04 02:31:20.050586 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 505/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:19 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:21.072455 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:21.073159 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: d3fd5241-bfc3-4826-b22d-8b5806f257c3] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:21.079361 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:21.079820 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:21.080594 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:21.081058 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:21.095282 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] HTTP exception thrown: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Request method failure captured: Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 HTTP/1.1 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y22raoOdXZU56m4OyWKNpa1ZcFPWPIntn2a9iQ5Ojtl2oYsQJAmly6RJOVt0tx_1WIq1ZXB5ChK7HbRFUrLee-KyVWOuhL_Q7wTo-fkncltjZCuQEadIdZ8ZbuHCWM8S_OG9XG-fH20YN4FbBYYyl9XgHHjbYOtKyTbvoK8tOSu6jI Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:31:21.096931 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 683f8f120df946f59505455a9ab2dc2a Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. Aug 04 02:31:21.098635 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'd3fd5241-bfc3-4826-b22d-8b5806f257c3'} Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:31:21.099581 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. Aug 04 02:31:21.101237 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:21.102673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Returning 404 to user: Instance d3fd5241-bfc3-4826-b22d-8b5806f257c3 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:31:21.102673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-8a780385-daa4-4abe-9a30-3e025f99a5ec tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3" status: 404 len: 111 microversion: 2.1 time: 0.031199 Aug 04 02:31:21.102673 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 524/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:21 2022] GET /compute/v2.1/servers/d3fd5241-bfc3-4826-b22d-8b5806f257c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:31:24.440498 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:24.441038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:24.442367 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-515a0a3b-9294-4069-bfbd-e23b9ba1a032 req-b68a3233-7bee-4344-8141-5706c278e27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b22a41-b90f-4c6f-b5b5-697dde2d49b8", "tag": "464771be-6667-4cc4-9015-5245b584f7ec"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:31:24.447715 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:24.448243 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:24.449140 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:24.449649 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:24.452989 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-515a0a3b-9294-4069-bfbd-e23b9ba1a032 req-b68a3233-7bee-4344-8141-5706c278e27a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:24.453445 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-515a0a3b-9294-4069-bfbd-e23b9ba1a032 req-b68a3233-7bee-4344-8141-5706c278e27a service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:24.466525 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-515a0a3b-9294-4069-bfbd-e23b9ba1a032 req-b68a3233-7bee-4344-8141-5706c278e27a service nova] Creating event network-changed:464771be-6667-4cc4-9015-5245b584f7ec for instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 on hv-cinder-74014 Aug 04 02:31:24.472290 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-515a0a3b-9294-4069-bfbd-e23b9ba1a032 req-b68a3233-7bee-4344-8141-5706c278e27a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033389 Aug 04 02:31:24.473215 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 525/1030] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:31:24.477398 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Going to try to terminate instance {{(pid=118167) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 02:31:24.571806 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-a5b9de9a-8116-4753-b9e6-c77025c41e28 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "DELETE /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 204 len: 0 microversion: 2.1 time: 0.134703 Aug 04 02:31:24.573227 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 506/1031] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:31:24 2022] DELETE /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 02:31:24.583592 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:24.584603 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:24.591751 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:24.592213 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:24.593051 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:24.593916 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:24.748708 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.policy [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118168) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:24.756971 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-4c851329-2615-44cc-8a5e-be4dc9cd4a99 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1577 microversion: 2.1 time: 0.177801 Aug 04 02:31:24.758049 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 526/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:24 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:25.780172 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:25.781035 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:25.788038 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:25.788490 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:25.789295 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:25.789735 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:25.933423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:25.941333 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-100fa5bd-6720-4dcd-ab9d-03e6f57983e8 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1577 microversion: 2.1 time: 0.165680 Aug 04 02:31:25.941916 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 507/1033] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:25 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:26.497885 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [req-f2d15ca7-fa6b-423a-8f3d-e1b2b90d2b47 req-71373347-1ed4-44c5-aa5f-c2a990933a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b22a41-b90f-4c6f-b5b5-697dde2d49b8", "name": "network-vif-deleted", "tag": "464771be-6667-4cc4-9015-5245b584f7ec"}]} {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 02:31:26.507815 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-f2d15ca7-fa6b-423a-8f3d-e1b2b90d2b47 req-71373347-1ed4-44c5-aa5f-c2a990933a9d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:26.508541 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [req-f2d15ca7-fa6b-423a-8f3d-e1b2b90d2b47 req-71373347-1ed4-44c5-aa5f-c2a990933a9d service nova] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:26.520041 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.compute.server_external_events [req-f2d15ca7-fa6b-423a-8f3d-e1b2b90d2b47 req-71373347-1ed4-44c5-aa5f-c2a990933a9d service nova] Creating event network-vif-deleted:464771be-6667-4cc4-9015-5245b584f7ec for instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 on hv-cinder-74014 Aug 04 02:31:26.524922 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [req-f2d15ca7-fa6b-423a-8f3d-e1b2b90d2b47 req-71373347-1ed4-44c5-aa5f-c2a990933a9d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Aug 04 02:31:26.525506 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 527/1034] 10.222.0.45 () {64 vars in 1317 bytes} [Thu Aug 4 02:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 02:31:26.963957 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:26.964476 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:26.971320 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:26.971777 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:26.972542 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:26.973075 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:27.005104 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:27.005566 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:27.006005 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.objects.instance [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lazy-loading 'fault' on Instance uuid 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 {{(pid=118167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 02:31:27.050423 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.policy [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683f8f120df946f59505455a9ab2dc2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4683550a9d40d1ab0439d002d73749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118167) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 02:31:27.058313 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-f15c441f-febe-4b9a-96bb-1ab2c554b402 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 200 len: 1230 microversion: 2.1 time: 0.099063 Aug 04 02:31:27.058909 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 508/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:26 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 02:31:28.081608 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:28.082316 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: 13b22a41-b90f-4c6f-b5b5-697dde2d49b8] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:28.089720 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.090280 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.091088 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.091535 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.105823 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] HTTP exception thrown: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Request method failure captured: Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 HTTP/1.1 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y22raoOdXZU56m4OyWKNpa1ZcFPWPIntn2a9iQ5Ojtl2oYsQJAmly6RJOVt0tx_1WIq1ZXB5ChK7HbRFUrLee-KyVWOuhL_Q7wTo-fkncltjZCuQEadIdZ8ZbuHCWM8S_OG9XG-fH20YN4FbBYYyl9XgHHjbYOtKyTbvoK8tOSu6jI Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:31:28.107493 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 683f8f120df946f59505455a9ab2dc2a Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. Aug 04 02:31:28.109180 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': '13b22a41-b90f-4c6f-b5b5-697dde2d49b8'} Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:31:28.110117 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. Aug 04 02:31:28.111628 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.113308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Returning 404 to user: Instance 13b22a41-b90f-4c6f-b5b5-697dde2d49b8 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:31:28.113308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-88a2189f-7adc-4099-91b3-7149d376a78a tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8" status: 404 len: 111 microversion: 2.1 time: 0.032164 Aug 04 02:31:28.113308 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 528/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:28 2022] GET /compute/v2.1/servers/13b22a41-b90f-4c6f-b5b5-697dde2d49b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:31:28.546207 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:28.546774 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.compute.api [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118167) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:28.553412 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.553870 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.554678 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.555103 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG oslo_concurrency.lockutils [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.568328 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.wsgi [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] HTTP exception thrown: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Request method failure captured: Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: request: DELETE /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 HTTP/1.1 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept: application/json Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Accept-Encoding: identity Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Connection: close Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Length: 0 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Content-Type: application/json Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Host: 10.222.0.45 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Openstack-System-Scope: None Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: User-Agent: python-urllib3/1.26.11 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Auth-Token: gAAAAABi6y22raoOdXZU56m4OyWKNpa1ZcFPWPIntn2a9iQ5Ojtl2oYsQJAmly6RJOVt0tx_1WIq1ZXB5ChK7HbRFUrLee-KyVWOuhL_Q7wTo-fkncltjZCuQEadIdZ8ZbuHCWM8S_OG9XG-fH20YN4FbBYYyl9XgHHjbYOtKyTbvoK8tOSu6jI Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Id: None Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Domain-Name: None Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Identity-Status: Confirmed Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Is-Admin-Project: True Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Id: default Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Domain-Name: Default Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Project-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Role: member,reader Aug 04 02:31:28.570574 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Roles: member,reader Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-Tenant-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Id: default Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Domain-Name: Default Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Id: 683f8f120df946f59505455a9ab2dc2a Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: X-User-Name: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: method: > Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: exception: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.572299 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: action_args: {'id': 'b3332bb9-b241-4099-9834-2c22f1241a44'} Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:31:28.573301 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.574908 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.576522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Returning 404 to user: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. {{(pid=118167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:31:28.576522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-8247e6ec-ee70-40f4-b24a-d63f35624544 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 404 len: 111 microversion: 2.1 time: 0.029698 Aug 04 02:31:28.576522 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 509/1037] 10.222.0.45 () {58 vars in 1239 bytes} [Thu Aug 4 02:31:28 2022] DELETE /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:31:28.581750 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '>' {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:28.582356 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.compute.api [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [instance: b3332bb9-b241-4099-9834-2c22f1241a44] Fetching instance by UUID {{(pid=118168) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 02:31:28.588862 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.589309 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.590066 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 02:31:28.590498 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG oslo_concurrency.lockutils [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Lock "4a58f248-bef7-4521-9706-ce0d39f099a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 02:31:28.603715 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.wsgi [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] HTTP exception thrown: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Request method failure captured: Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: request: GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 HTTP/1.1 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept: application/json Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Accept-Encoding: identity Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Connection: close Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Length: 0 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Content-Type: application/json Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Host: 10.222.0.45 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Openstack-System-Scope: None Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: User-Agent: python-urllib3/1.26.11 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Auth-Token: gAAAAABi6y22raoOdXZU56m4OyWKNpa1ZcFPWPIntn2a9iQ5Ojtl2oYsQJAmly6RJOVt0tx_1WIq1ZXB5ChK7HbRFUrLee-KyVWOuhL_Q7wTo-fkncltjZCuQEadIdZ8ZbuHCWM8S_OG9XG-fH20YN4FbBYYyl9XgHHjbYOtKyTbvoK8tOSu6jI Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Id: None Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Domain-Name: None Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Identity-Status: Confirmed Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Is-Admin-Project: True Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Id: default Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Domain-Name: Default Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Project-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Role: member,reader Aug 04 02:31:28.605236 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Roles: member,reader Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f4683550a9d40d1ab0439d002d73749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}] Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Id: 5f4683550a9d40d1ab0439d002d73749 Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-Tenant-Name: tempest-TestVolumeBootPattern-1588286456 Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Id: default Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Domain-Name: Default Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Id: 683f8f120df946f59505455a9ab2dc2a Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: X-User-Name: tempest-TestVolumeBootPattern-1588286456-project Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: method: > Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: exception: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.606888 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: action_args: {'id': 'b3332bb9-b241-4099-9834-2c22f1241a44'} Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: {{(pid=118168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 02:31:28.608437 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. Aug 04 02:31:28.609978 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: ERROR nova.api.openstack.wsgi Aug 04 02:31:28.611326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: DEBUG nova.api.openstack.wsgi [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Returning 404 to user: Instance b3332bb9-b241-4099-9834-2c22f1241a44 could not be found. {{(pid=118168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 02:31:28.611326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO nova.api.openstack.requestlog [None req-c4219698-e814-46ff-8a3b-45b7b2a4b4e7 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44" status: 404 len: 111 microversion: 2.1 time: 0.028648 Aug 04 02:31:28.611326 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: [pid: 118168|app: 0|req: 529/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Thu Aug 4 02:31:28 2022] GET /compute/v2.1/servers/b3332bb9-b241-4099-9834-2c22f1241a44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 02:31:29.901615 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: DEBUG nova.api.openstack.wsgi [None req-cd5da490-52ca-4752-9961-1f0e5d2d6e02 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] Calling method '.version_select at 0x7ff48f5a5dc0>' {{(pid=118167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 02:31:29.906275 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd5da490-52ca-4752-9961-1f0e5d2d6e02 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [7de3fb52-6a7c-4d35-85a1-14f0d7336489] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 02:31:30.914100 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd5da490-52ca-4752-9961-1f0e5d2d6e02 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] [7de3fb52-6a7c-4d35-85a1-14f0d7336489] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48590. Aug 04 02:31:30.933594 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO nova.api.openstack.requestlog [None req-cd5da490-52ca-4752-9961-1f0e5d2d6e02 tempest-TestVolumeBootPattern-1588286456 tempest-TestVolumeBootPattern-1588286456-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1537706057" status: 202 len: 0 microversion: 2.1 time: 1.036294 Aug 04 02:31:30.934171 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: [pid: 118167|app: 0|req: 510/1039] 10.222.0.45 () {58 vars in 1263 bytes} [Thu Aug 4 02:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1537706057 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 02:32:06.503638 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:32:06.504284 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:32:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:32:14.774762 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:32:14.775351 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Thu Aug 4 02:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:33:55.051116 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:33:55.051713 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:34:12.555859 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:34:12.556497 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Thu Aug 4 02:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:35:26.512181 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:35:26.512839 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:35:34.782290 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:35:34.782835 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Thu Aug 4 02:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:37:15.060435 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:37:15.061125 dv-cinder-740146-17-iscsi devstack@n-api.service[118168]: Thu Aug 4 02:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 02:37:15.957300 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 02:37:15.957863 dv-cinder-740146-17-iscsi devstack@n-api.service[118167]: Thu Aug 4 02:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!